Sep 23 00:05:47 devstack cinder-volume[75388]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:05:47 devstack cinder-volume[75388]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:05:47 devstack cinder-volume[75388]: we strongly recommend against using it for new projects. Sep 23 00:05:47 devstack cinder-volume[75388]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:05:47 devstack cinder-volume[75388]: framework. For more detail see Sep 23 00:05:47 devstack cinder-volume[75388]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:05:47 devstack cinder-volume[75388]: import eventlet # noqa Sep 23 00:05:49 devstack cinder-volume[75388]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:05:49 devstack cinder-volume[75388]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:05:49 devstack cinder-volume[75388]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:05:50 devstack cinder-volume[75388]: INFO dbcounter [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Registered counter for database cinder Sep 23 00:05:50 devstack cinder-volume[75388]: DEBUG oslo_db.sqlalchemy.engines [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:51 devstack cinder-volume[75388]: DEBUG dbcounter [-] [75388] Writer thread running {{(pid=75388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:05:51 devstack cinder-volume[75388]: INFO cinder.rpc [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:05:51 devstack cinder-volume[75388]: INFO cinder.rpc [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:05:51 devstack cinder-volume[75388]: DEBUG oslo_db.sqlalchemy.engines [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:51 devstack cinder-volume[75388]: INFO cinder.volume.manager [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Determined volume DB was empty at startup. Sep 23 00:05:51 devstack cinder-volume[75388]: DEBUG cinder.volume.manager [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75388) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:05:51 devstack cinder-volume[75388]: INFO cinder.volume.manager [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:05:51 devstack cinder-volume[75388]: WARNING stevedore.named [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:05:51 devstack cinder-volume[75388]: WARNING castellan.key_manager [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:05:51 devstack cinder-volume[75388]: WARNING cinder.keymgr.conf_key_mgr [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:05:51 devstack cinder-volume[75388]: DEBUG cinder.volume.drivers.lvm [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75388) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 23 00:05:51 devstack cinder-volume[75388]: DEBUG oslo_concurrency.processutils [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:51 devstack cinder-volume[75388]: DEBUG oslo_concurrency.processutils [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.480s {{(pid=75388) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_db.sqlalchemy.engines [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:52 devstack cinder-volume[75388]: INFO cinder.rpc [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 23 00:05:52 devstack cinder-volume[75388]: INFO cinder.rpc [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 23 00:05:52 devstack cinder-volume[75388]: WARNING stevedore.named [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:05:52 devstack cinder-volume[75388]: WARNING castellan.key_manager [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:05:52 devstack cinder-volume[75388]: INFO cinder.volume.manager [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_db.sqlalchemy.engines [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75388) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:52 devstack cinder-volume[75388]: INFO oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Starting 1 workers Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Started child 75546 {{(pid=75388) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Full set of CONF: {{(pid=75388) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] ******************************************************************************** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Configuration options gathered from: {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] ================================================================================ {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] allow_availability_zone_fallback = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] allow_compression_on_image_upload = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] allowed_direct_url_schemes = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] api_rate_limit = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] auth_strategy = keystone {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] az_cache_duration = 3600 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75546]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_availability_zone = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_host = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_stats_polling_interval = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backup_api_class = cinder.backup.api.API {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backup_name_template = backup-%s {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backup_use_same_host = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backup_use_temp_snapshot = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] chap_password = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] chap_username = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cinder_internal_tenant_project_id = 2ab177e8077e466294ae426b625c11f1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cinder_internal_tenant_user_id = 5e791e89086a48c381cf4531e3ece8b7 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cloned_volume_same_az = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cluster = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] compression_format = gzip {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] config_dir = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] config_source = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] control_exchange = openstack {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] debug = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] default_availability_zone = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] default_group_type = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] default_volume_type = lvmdriver-1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] deployment_max_gigabytes = -1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] disk_geometry = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] driver_client_cert = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] driver_client_cert_key = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] driver_data_namespace = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] driver_ssl_cert_path = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] driver_ssl_cert_verify = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] driver_use_ssl = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] enable_force_upload = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] enable_new_services = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] enable_unsupported_driver = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] enforce_multipath_for_image_xfer = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] filter_function = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_api_insecure = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_api_servers = ['http://192.168.122.205/image'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_api_ssl_compression = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_ca_certificates_file = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_certfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_keyfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_num_retries = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance_request_timeout = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] goodness_function = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] graceful_shutdown_timeout = 5 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] group_api_class = cinder.group.api.API {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] host = devstack {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_compress_on_upload = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_conversion_address_space_limit = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_conversion_cpu_limit = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_conversion_disable = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_introspection_address_space_limit = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_introspection_cpu_limit = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_upload_use_cinder_backend = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_upload_use_internal_tenant = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_volume_cache_enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_volume_cache_max_count = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] init_host_max_objects_retrieval = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] instance_format = [instance: %(uuid)s] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] iscsi_target_flags = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] iscsi_write_cache = on {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] iser_helper = tgtadm {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] iser_ip_address = 192.168.122.205 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] iser_port = 3260 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] log_color = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] log_config_append = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] log_dir = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] log_file = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] log_options = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] log_rotate_interval = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] log_rotate_interval_type = days {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] log_rotation_type = none {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] max_age = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] max_logfile_count = 30 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] max_logfile_size_mb = 200 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] max_over_subscription_ratio = 20.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] message_reap_interval = 86400 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] message_ttl = 2592000 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] monkey_patch = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75546]: INFO cinder.volume.manager [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] monkey_patch_modules = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] my_ip = 192.168.122.205 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] no_snapshot_gb_quota = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] num_iser_scan_tries = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] num_shell_tries = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] num_volume_device_scan_tries = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] nvmeof_conn_info_version = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] nvmet_ns_id = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] nvmet_port_id = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] osapi_max_limit = 1000 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] osapi_volume_ext_list = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] osapi_volume_listen_port = 8776 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] osapi_volume_use_ssl = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] osapi_volume_workers = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] per_volume_size_limit = -1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] periodic_fuzzy_delay = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] periodic_interval = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] public_endpoint = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] publish_errors = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] quota_backup_gigabytes = 1000 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] quota_backups = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] quota_gigabytes = 1000 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] quota_groups = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] quota_snapshots = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] quota_volumes = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] rate_limit_burst = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] rate_limit_except_level = CRITICAL {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] rate_limit_interval = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] reinit_driver_count = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] replication_device = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] report_discard_supported = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] report_interval = 120 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] reservation_clean_interval = 86400 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] reservation_expire = 86400 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] reserved_image_namespaces = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] reserved_percentage = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] rpc_response_timeout = 120 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] run_external_periodic_tasks = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] scst_target_driver = iscsi {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] scst_target_iqn_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_down_time = 720 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] shell_completion = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] snapshot_name_template = snapshot-%s {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] snapshot_same_host = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] split_loggers = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] state_path = /opt/stack/data/cinder {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] storage_availability_zone = nova {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] storage_protocol = iSCSI {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] syslog_log_facility = LOG_USER {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] target_helper = lioadm {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] target_ip_address = 192.168.122.205 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] target_port = 3260 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] target_protocol = iscsi {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] target_secondary_ip_addresses = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] trace_flags = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] transport_url = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] until_refresh = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] use_chap_auth = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] use_default_quota_class = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] use_journal = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] use_json = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] use_multipath_for_image_xfer = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] use_stderr = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] use_syslog = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] verify_glance_signatures = enabled {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_api_class = cinder.volume.api.API {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_backend_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_clear = zero {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_clear_ionice = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_clear_size = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_copy_bps_limit = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_dd_blocksize = 1M {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_name_template = volume-%s {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_service_inithost_offload = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volume_usage_audit_period = month {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] zoning_mode = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.auth_section = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.auth_type = password {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.auth_version = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.cache = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.certfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.insecure = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.interface = public {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.keyfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_password = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcache_username = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.region_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.service_type = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.205/identity {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.backend = dogpile.cache.null {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.backend_argument = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.backend_expiration_time = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.config_prefix = cache.oslo {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.debug_cache_backend = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.enable_retry_client = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.enable_socket_keepalive = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.expiration_time = 600 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.memcache_dead_retry = 300 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.memcache_sasl_enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.password = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.proxies = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.redis_db = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.redis_server = localhost:6379 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.retry_attempts = 2 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.retry_delay = 0.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.socket_keepalive_count = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.socket_keepalive_idle = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.socket_keepalive_interval = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.socket_timeout = 1.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.tls_allowed_ciphers = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.tls_cafile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.tls_certfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.tls_enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.tls_keyfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cache.username = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] coordination.backend_url = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.asyncio_connection = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.asyncio_slave_connection = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.backend = sqlalchemy {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.connection = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.connection_debug = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.connection_parameters = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.connection_recycle_time = 3600 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.connection_trace = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.db_inc_retry_interval = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.db_max_retries = 20 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.db_max_retry_interval = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.db_retry_interval = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.max_overflow = 50 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.max_pool_size = 5 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.max_retries = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.pool_timeout = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.retry_interval = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.slave_connection = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.sqlite_synchronous = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.synchronous_reader = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] database.use_db_reconnect = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_tracing.insecure = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.connection_string = messaging:// {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.es_doc_type = notification {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.es_scroll_size = 10000 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.es_scroll_time = 2m {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.filter_error_trace = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.hmac_keys = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.sentinel_service_name = mymaster {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.socket_timeout = 0.1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.trace_requests = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler.trace_sqlalchemy = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler_jaeger.process_tags = {} {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] profiler_otlp.service_name_prefix = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.enforce_new_defaults = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.policy_default_rule = default {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] privsep_osbrick.group = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] privsep_osbrick.helper_command = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] privsep_osbrick.user = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cinder_sys_admin.group = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cinder_sys_admin.helper_command = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] cinder_sys_admin.user = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.auth_section = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.auth_type = password {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.cafile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.certfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.collect_timing = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.insecure = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.keyfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.send_service_user_token = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.split_loggers = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.timeout = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.tls_ciphers = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] service_user.tls_min_version = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.auth_section = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.auth_type = password {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.certfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.collect_timing = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.insecure = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.keyfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.region_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.split_loggers = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.timeout = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.tls_ciphers = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] glance.tls_min_version = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.backend_availability_zone = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.chap_password = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.chap_username = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.disk_geometry = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.driver_client_cert = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.driver_data_namespace = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.driver_use_ssl = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.extra_capabilities = {} {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.filter_function = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.goodness_function = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack sudo[75550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.iscsi_target_flags = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.iser_ip_address = 192.168.122.205 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.iser_port = 3260 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack sudo[75550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.lvm_share_target = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.lvm_type = auto {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.replication_device = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.report_discard_supported = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.target_helper = tgtadm {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.target_ip_address = 192.168.122.205 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.target_port = 3260 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.target_protocol = iscsi {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.trace_flags = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.use_chap_auth = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volume_backend_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volume_clear = zero {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_reports.file_event_handler = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_reports.log_dir = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.backend_host = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.chap_password = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.chap_username = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.disk_geometry = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.filter_function = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.goodness_function = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.iser_helper = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.iser_port = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.lvm_type = auto {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.replication_device = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.storage_protocol = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.target_ip_address = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.target_port = 3260 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.trace_flags = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volume_clear = zero {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] lvmdriver-1.volumes_dir = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_notifications.driver = [] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] key_manager.fixed_key = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.barbican_api_version = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.barbican_endpoint = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.barbican_endpoint_type = public {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.barbican_region_name = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.cafile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.certfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.collect_timing = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.insecure = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.keyfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.number_of_retries = 60 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.retry_delay = 1 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.send_service_user_token = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.split_loggers = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.timeout = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.tls_ciphers = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.tls_min_version = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.verify_ssl = True {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican.verify_ssl_path = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.auth_section = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.auth_type = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.cafile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.certfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.collect_timing = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.insecure = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.keyfile = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.split_loggers = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.timeout = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.tls_ciphers = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] barbican_service_user.tls_min_version = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.approle_role_id = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.approle_secret_id = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.auth_method = approle {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.auth_path = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.kv_mountpoint = secret {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.kv_path = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.kv_version = 2 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.namespace = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.root_token_id = **** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.ssl_ca_crt_file = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.timeout = 60.0 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.token_file = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.token_role = None {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.use_ssl = False {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:05:52 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] ******************************************************************************** {{(pid=75388) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:05:52 devstack sudo[75550]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:52 devstack sudo[75553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:52 devstack sudo[75553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:52 devstack sudo[75553]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.297s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:05:52 devstack cinder-volume[75546]: INFO cinder.brick.local_dev.lvm [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:52 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:52 devstack sudo[75712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:52 devstack sudo[75712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:53 devstack sudo[75712]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:53 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:53 devstack cinder-volume[75546]: DEBUG cinder.brick.local_dev.lvm [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75546) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 23 00:05:53 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:53 devstack sudo[75826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:53 devstack sudo[75826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:53 devstack sudo[75826]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:53 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.537s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:53 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:53 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:53 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:53 devstack sudo[76027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:53 devstack sudo[76027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:54 devstack sudo[76027]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:54 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:54 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:54 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:54 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:54 devstack sudo[76152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 23 00:05:54 devstack sudo[76152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:54 devstack sudo[76152]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:54 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.279s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:54 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:54 devstack sudo[76155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:54 devstack sudo[76155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:54 devstack sudo[76155]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:54 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:54 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:54 devstack sudo[76238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:54 devstack sudo[76238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:55 devstack sudo[76238]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:55 devstack sudo[76241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:55 devstack sudo[76241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:55 devstack sudo[76241]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:55 devstack sudo[76283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:55 devstack sudo[76283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:55 devstack sudo[76283]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:55 devstack sudo[76334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:55 devstack sudo[76334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:55 devstack sudo[76334]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:55 devstack cinder-volume[75546]: INFO cinder.volume.drivers.lvm [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:55 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:55 devstack sudo[76357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:55 devstack sudo[76357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:56 devstack sudo[76357]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:56 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.355s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:56 devstack cinder-volume[75546]: DEBUG cinder.volume.drivers.lvm [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Updating volume stats {{(pid=75546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:56 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:56 devstack sudo[76381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:56 devstack sudo[76381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:56 devstack sudo[76381]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:56 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:56 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:56 devstack sudo[76384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:56 devstack sudo[76384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:57 devstack sudo[76384]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:57 devstack sudo[76390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:57 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:57 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:57 devstack sudo[76393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:57 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:57 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:57 devstack cinder-volume[75546]: INFO cinder.volume.driver [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG cinder.volume.driver [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75546) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG oslo_db.sqlalchemy.engines [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75546) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG dbcounter [-] [75546] Writer thread running {{(pid=75546) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG cinder.db.api [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Building query based on filter {{(pid=75546) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4158}} Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG cinder.image.image_utils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75546) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:05:57 devstack cinder-volume[75546]: INFO cinder.keymgr.migration [None req-5a06804d-12c2-4b18-878c-ade46a942be7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG cinder.volume.drivers.lvm [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Updating volume stats {{(pid=75546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:57 devstack sudo[76397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:57 devstack sudo[76397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:57 devstack sudo[76397]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:57 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:58 devstack sudo[76400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:58 devstack sudo[76400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:58 devstack sudo[76400]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:58 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:58 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:58 devstack sudo[76404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:58 devstack sudo[76404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:58 devstack sudo[76404]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:58 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:58 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:58 devstack sudo[76408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:58 devstack sudo[76408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:58 devstack sudo[76408]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:58 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:58 devstack cinder-volume[75546]: DEBUG cinder.manager [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Notifying Schedulers of capabilities ... {{(pid=75546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:05:58 devstack cinder-volume[75546]: INFO cinder.volume.manager [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Driver initialization completed successfully. Sep 23 00:05:58 devstack cinder-volume[75546]: INFO cinder.manager [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Initiating service 2 cleanup Sep 23 00:05:58 devstack cinder-volume[75546]: INFO cinder.manager [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Service 2 cleanup completed. Sep 23 00:05:58 devstack cinder-volume[75546]: DEBUG cinder.service [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Creating RPC server for service cinder-volume {{(pid=75546) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:05:58 devstack cinder-volume[75546]: DEBUG cinder.service [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75546) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:05:59 devstack cinder-volume[75546]: INFO cinder.volume.manager [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 23 00:05:59 devstack cinder-volume[75546]: DEBUG cinder.volume.drivers.lvm [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Updating volume stats {{(pid=75546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:05:59 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:59 devstack sudo[76412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:05:59 devstack sudo[76412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:59 devstack sudo[76412]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:59 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:59 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:59 devstack sudo[76415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:59 devstack sudo[76415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:59 devstack sudo[76415]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:59 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:59 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:59 devstack sudo[76422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:05:59 devstack sudo[76422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:05:59 devstack sudo[76422]: pam_unix(sudo:session): session closed for user root Sep 23 00:05:59 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:05:59 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:05:59 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:05:59 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:06:00 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Sep 23 00:06:00 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:06:00 devstack cinder-volume[75546]: INFO cinder.volume.manager [None req-9664e1c4-4e62-46a1-982b-90c2b1501268 None None] Driver post RPC initialization completed successfully. Sep 23 00:06:02 devstack cinder-volume[75388]: DEBUG dbcounter [-] [75388] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75388) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:06:07 devstack cinder-volume[75546]: DEBUG dbcounter [-] [75546] Writing DB stats cinder:SELECT=2 {{(pid=75546) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:06:10 devstack cinder-volume[75546]: DEBUG dbcounter [-] [75546] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75546) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:06:48 devstack cinder-volume[75546]: DEBUG oslo_service.periodic_task [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running periodic task VolumeManager._thread_info {{(pid=75546) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:06:48 devstack cinder-volume[75546]: DEBUG cinder.volume.manager [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] thread count: 6 {{(pid=75546) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:06:48 devstack cinder-volume[75546]: DEBUG cinder.volume.manager [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] thread info: [<_MainThread(MainThread, started 134475731632256)>, , , , , ] {{(pid=75546) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:07:48 devstack cinder-volume[75546]: DEBUG oslo_service.periodic_task [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75546) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:07:48 devstack cinder-volume[75546]: DEBUG cinder.volume.drivers.lvm [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Updating volume stats {{(pid=75546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:07:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:48 devstack sudo[81623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:07:48 devstack sudo[81623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:48 devstack sudo[81623]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:48 devstack sudo[81626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:48 devstack sudo[81626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:48 devstack sudo[81626]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:48 devstack sudo[81630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:07:48 devstack sudo[81630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:48 devstack sudo[81630]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:07:48 devstack sudo[81633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:07:48 devstack sudo[81633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:07:49 devstack sudo[81633]: pam_unix(sudo:session): session closed for user root Sep 23 00:07:49 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:07:49 devstack cinder-volume[75546]: DEBUG cinder.manager [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Notifying Schedulers of capabilities ... {{(pid=75546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:07:49 devstack cinder-volume[75546]: DEBUG oslo_service.periodic_task [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running periodic task VolumeManager._thread_info {{(pid=75546) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:07:49 devstack cinder-volume[75546]: DEBUG cinder.volume.manager [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] thread count: 6 {{(pid=75546) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:07:49 devstack cinder-volume[75546]: DEBUG cinder.volume.manager [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] thread info: [<_MainThread(MainThread, started 134475731632256)>, , , , , ] {{(pid=75546) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:08:10 devstack cinder-volume[75546]: DEBUG dbcounter [-] [75546] Writing DB stats cinder:SELECT=1 {{(pid=75546) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:10 devstack cinder-volume[75546]: DEBUG dbcounter [-] [75546] Writing DB stats cinder:UPDATE=1 {{(pid=75546) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:08:48 devstack cinder-volume[75546]: DEBUG oslo_service.periodic_task [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75546) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:08:48 devstack cinder-volume[75546]: DEBUG cinder.volume.drivers.lvm [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Updating volume stats {{(pid=75546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:08:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:48 devstack sudo[83263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:08:48 devstack sudo[83263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:48 devstack sudo[83263]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:48 devstack sudo[83274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:48 devstack sudo[83274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:48 devstack sudo[83274]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:48 devstack sudo[83300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:08:48 devstack sudo[83300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:48 devstack sudo[83300]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:49 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:49 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:08:49 devstack sudo[83305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:08:49 devstack sudo[83305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:08:49 devstack sudo[83305]: pam_unix(sudo:session): session closed for user root Sep 23 00:08:49 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:08:49 devstack cinder-volume[75546]: DEBUG cinder.manager [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Notifying Schedulers of capabilities ... {{(pid=75546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:09:48 devstack cinder-volume[75546]: DEBUG oslo_service.periodic_task [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75546) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:09:48 devstack cinder-volume[75546]: DEBUG cinder.volume.drivers.lvm [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Updating volume stats {{(pid=75546) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 23 00:09:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:48 devstack sudo[84601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 23 00:09:48 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:48 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:48 devstack sudo[84604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:09:48 devstack sudo[84604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:48 devstack sudo[84604]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:48 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:48 devstack sudo[84608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 23 00:09:48 devstack sudo[84608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:49 devstack sudo[84608]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:49 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.380s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:49 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:09:49 devstack sudo[84629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 23 00:09:49 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:09:49 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root Sep 23 00:09:49 devstack cinder-volume[75546]: DEBUG oslo_concurrency.processutils [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:09:49 devstack cinder-volume[75546]: DEBUG cinder.manager [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Notifying Schedulers of capabilities ... {{(pid=75546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:09:49 devstack cinder-volume[75546]: DEBUG oslo_service.periodic_task [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] Running periodic task VolumeManager._thread_info {{(pid=75546) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:09:49 devstack cinder-volume[75546]: DEBUG cinder.volume.manager [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] thread count: 6 {{(pid=75546) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:09:49 devstack cinder-volume[75546]: DEBUG cinder.volume.manager [None req-7f29ee37-10b0-44e1-b876-b01a02e7d72b None None] thread info: [<_MainThread(MainThread, started 134475731632256)>, , , , , ] {{(pid=75546) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:10:10 devstack cinder-volume[75546]: DEBUG dbcounter [-] [75546] Writing DB stats cinder:SELECT=1 {{(pid=75546) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:10 devstack cinder-volume[75546]: DEBUG dbcounter [-] [75546] Writing DB stats cinder:UPDATE=1 {{(pid=75546) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:10:42 devstack cinder-volume[75388]: INFO oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Caught SIGTERM, stopping children Sep 23 00:10:42 devstack cinder-volume[75388]: DEBUG oslo_concurrency.lockutils [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Acquiring lock "singleton_lock" {{(pid=75388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:42 devstack cinder-volume[75388]: DEBUG oslo_concurrency.lockutils [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Acquired lock "singleton_lock" {{(pid=75388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:42 devstack cinder-volume[75388]: DEBUG oslo_concurrency.lockutils [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Releasing lock "singleton_lock" {{(pid=75388) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:42 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Stop services. {{(pid=75388) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:10:42 devstack cinder-volume[75388]: DEBUG oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Killing children. {{(pid=75388) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:10:42 devstack cinder-volume[75388]: INFO oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Waiting on 1 children to exit Sep 23 00:10:44 devstack cinder-volume[75546]: DEBUG oslo_concurrency.lockutils [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Acquiring lock "singleton_lock" {{(pid=75546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:44 devstack cinder-volume[75546]: DEBUG oslo_concurrency.lockutils [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Acquired lock "singleton_lock" {{(pid=75546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:44 devstack cinder-volume[75546]: DEBUG oslo_concurrency.lockutils [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Releasing lock "singleton_lock" {{(pid=75546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:44 devstack cinder-volume[75546]: WARNING amqp [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:10:44 devstack cinder-volume[75546]: WARNING amqp [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:10:44 devstack cinder-volume[75388]: INFO oslo_service.backend._eventlet.service [None req-88187ba0-2804-4086-8b2d-886add06f8c7 None None] Child 75546 exited with status 0 Sep 23 00:10:44 devstack cinder-volume[86214]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:10:44 devstack cinder-volume[86214]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:10:44 devstack cinder-volume[86214]: we strongly recommend against using it for new projects. Sep 23 00:10:44 devstack cinder-volume[86214]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:10:44 devstack cinder-volume[86214]: framework. For more detail see Sep 23 00:10:44 devstack cinder-volume[86214]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:10:44 devstack cinder-volume[86214]: import eventlet # noqa Sep 23 00:10:46 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:46 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:46 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:47 devstack cinder-volume[86214]: INFO dbcounter [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Registered counter for database cinder Sep 23 00:10:47 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG dbcounter [-] [86214] Writer thread running {{(pid=86214) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:48 devstack cinder-volume[86214]: INFO cinder.rpc [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:10:48 devstack cinder-volume[86214]: INFO cinder.rpc [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:48 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Determined volume DB was empty at startup. Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG cinder.volume.manager [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86214) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:10:48 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 23 00:10:48 devstack cinder-volume[86214]: WARNING stevedore.named [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:10:48 devstack cinder-volume[86214]: WARNING castellan.key_manager [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:48 devstack cinder-volume[86214]: WARNING cinder.keymgr.conf_key_mgr [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:10:48 devstack cinder-volume[86214]: INFO cinder.volume.manager [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_db.sqlalchemy.engines [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86214) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:48 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Starting 1 workers Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Started child 86458 {{(pid=86214) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Full set of CONF: {{(pid=86214) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] ******************************************************************************** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Configuration options gathered from: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] ================================================================================ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] allow_availability_zone_fallback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] allow_compression_on_image_upload = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] allowed_direct_url_schemes = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] api_rate_limit = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] auth_strategy = keystone {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_host = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_stats_polling_interval = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86458]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backup_api_class = cinder.backup.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backup_name_template = backup-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backup_use_same_host = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backup_use_temp_snapshot = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] chap_username = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cinder_internal_tenant_project_id = 2ab177e8077e466294ae426b625c11f1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cinder_internal_tenant_user_id = 5e791e89086a48c381cf4531e3ece8b7 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cluster = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] compression_format = gzip {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] compute_api_class = cinder.compute.nova.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] config_dir = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] config_source = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] control_exchange = openstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] debug = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] default_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] default_group_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] default_volume_type = QuobyteHD {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] deployment_max_gigabytes = -1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] driver_ssl_cert_verify = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] driver_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] enable_new_services = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] enable_unsupported_driver = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] enabled_backends = ['QuobyteHD'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] enforce_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_api_insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_api_servers = ['http://192.168.122.205/image'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_api_ssl_compression = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_ca_certificates_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_catalog_info = image:glance:publicURL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_num_retries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance_request_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] graceful_shutdown_timeout = 5 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] group_api_class = cinder.group.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] host = devstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_compress_on_upload = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_conversion_address_space_limit = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_conversion_cpu_limit = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_conversion_disable = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_introspection_address_space_limit = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_introspection_cpu_limit = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_upload_use_cinder_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_upload_use_internal_tenant = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_volume_cache_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_volume_cache_max_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] image_volume_cache_max_size_gb = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] init_host_max_objects_retrieval = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] instance_format = [instance: %(uuid)s] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86458]: INFO cinder.volume.manager [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] iscsi_target_flags = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] iscsi_write_cache = on {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] iser_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.remotefs [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86458) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] iser_ip_address = 192.168.122.205 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] iser_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] log_color = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] log_config_append = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] log_dir = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] log_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] log_options = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] log_rotate_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] log_rotate_interval_type = days {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] log_rotation_type = none {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] max_age = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] max_logfile_count = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] max_logfile_size_mb = 200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] max_over_subscription_ratio = 20.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] message_reap_interval = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] message_ttl = 2592000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] migration_create_volume_timeout_secs = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] monkey_patch = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] monkey_patch_modules = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] my_ip = 192.168.122.205 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] no_snapshot_gb_quota = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] num_iser_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] num_shell_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] num_volume_device_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] nvmeof_conn_info_version = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] nvmet_ns_id = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] nvmet_port_id = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] osapi_max_limit = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] osapi_volume_ext_list = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] osapi_volume_listen_port = 8776 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] osapi_volume_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] osapi_volume_workers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] per_volume_size_limit = -1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] periodic_fuzzy_delay = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] periodic_interval = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] public_endpoint = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] publish_errors = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] quota_backup_gigabytes = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] quota_backups = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] quota_gigabytes = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] quota_groups = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] quota_snapshots = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] quota_volumes = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] rate_limit_burst = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] rate_limit_except_level = CRITICAL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] rate_limit_interval = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] reinit_driver_count = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] report_discard_supported = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] report_interval = 120 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] reservation_clean_interval = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] reservation_expire = 86400 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] reserved_image_namespaces = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] reserved_percentage = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] rpc_response_timeout = 120 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] run_external_periodic_tasks = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] scst_target_driver = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_down_time = 720 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] shell_completion = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] snapshot_name_template = snapshot-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] state_path = /opt/stack/data/cinder {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] storage_availability_zone = nova {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] storage_protocol = iSCSI {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] syslog_log_facility = LOG_USER {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] target_helper = lioadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] target_ip_address = 192.168.122.205 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] target_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] target_protocol = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] target_secondary_ip_addresses = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] trace_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] transport_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] until_refresh = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] use_chap_auth = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] use_default_quota_class = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] use_journal = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] use_json = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] use_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] use_stderr = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] use_syslog = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] verify_glance_signatures = enabled {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_api_class = cinder.volume.api.API {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_clear = zero {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_clear_size = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_copy_bps_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86458) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:10:48 devstack cinder-volume[86458]: WARNING cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:10:48 devstack cinder-volume[86458]: WARNING cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_dd_blocksize = 1M {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Running cmd (subprocess): mount.quobyte {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_name_template = volume-%s {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_service_inithost_offload = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volume_usage_audit_period = month {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] zoning_mode = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_concurrency.disable_process_locking = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.auth_type = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.auth_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.include_service_catalog = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.interface = public {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcache_username = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.service_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.205/identity {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.backend = dogpile.cache.null {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.backend_argument = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.backend_expiration_time = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.config_prefix = cache.oslo {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.debug_cache_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.enable_retry_client = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.enable_socket_keepalive = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.expiration_time = 600 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.hashclient_retry_attempts = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.memcache_dead_retry = 300 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.memcache_pool_maxsize = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.memcache_sasl_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.proxies = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.redis_db = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.redis_server = localhost:6379 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.retry_attempts = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.retry_delay = 0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.socket_keepalive_count = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.socket_keepalive_idle = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.socket_keepalive_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.socket_timeout = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.tls_allowed_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.tls_cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.tls_certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.tls_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.tls_keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cache.username = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] coordination.backend_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.asyncio_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.asyncio_slave_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.backend = sqlalchemy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.connection_debug = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.connection_parameters = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.connection_recycle_time = 3600 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.connection_trace = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.db_inc_retry_interval = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.db_max_retries = 20 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.db_max_retry_interval = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.db_retry_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.max_overflow = 50 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack quobyte-client[86464]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:10:48 devstack quobyte-client[86464]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.max_pool_size = 5 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.max_retries = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.mysql_wsrep_sync_wait = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.pool_timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.retry_interval = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.slave_connection = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.sqlite_synchronous = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.synchronous_reader = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:48 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=86458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] database.use_db_reconnect = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86458]: INFO cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 ... Sep 23 00:10:48 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 -c /etc/quobyte/client-cinder.cfg {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_tracing.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.connection_string = messaging:// {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.es_doc_type = notification {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.es_scroll_size = 10000 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.es_scroll_time = 2m {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.filter_error_trace = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.hmac_keys = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.sentinel_service_name = mymaster {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.socket_timeout = 0.1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.trace_requests = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler.trace_sqlalchemy = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler_jaeger.process_tags = {} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler_jaeger.service_name_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] profiler_otlp.service_name_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.enforce_new_defaults = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.policy_default_rule = default {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.policy_file = policy.yaml {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack sudo[86465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 -c /etc/quobyte/client-cinder.cfg Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] privsep_osbrick.group = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] privsep_osbrick.helper_command = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] privsep_osbrick.user = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cinder_sys_admin.group = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cinder_sys_admin.helper_command = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] cinder_sys_admin.user = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.auth_type = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.send_service_user_token = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.tls_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] service_user.tls_min_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.auth_type = password {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.tls_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] glance.tls_min_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.chap_username = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.driver_use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.extra_capabilities = {} {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.iscsi_target_flags = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.iscsi_write_cache = on {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.iser_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.iser_ip_address = 192.168.122.205 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.iser_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_host = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_login = admin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_mount_options = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_private_key = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_share_path = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.num_shell_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.quobyte_volume_url = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.report_discard_supported = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.reserved_percentage = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.target_helper = tgtadm {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.target_ip_address = 192.168.122.205 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.target_port = 3260 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.target_protocol = iscsi {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.trace_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.unique_fqdn_network = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.use_chap_auth = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.volume_backend_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.volume_clear = zero {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.volume_clear_size = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_reports.file_event_handler = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_reports.log_dir = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.backend_availability_zone = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.backend_host = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.chap_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.chap_username = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.chiscsi_conf = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.disk_geometry = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.driver_client_cert = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.driver_data_namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.driver_use_ssl = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.extra_capabilities = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.filter_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.goodness_function = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.iser_helper = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.iser_ip_address = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.iser_port = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.iser_target_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_host = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_login = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_mount_options = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_password = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_private_key = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_share_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_ssh_port = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.num_shell_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.nvmet_port_id = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.replication_device = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.report_discard_supported = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.reserved_percentage = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.scst_target_driver = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.storage_protocol = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.target_helper = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.target_ip_address = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.target_port = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.target_prefix = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.target_protocol = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.trace_flags = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.use_chap_auth = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.volume_clear = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.volume_clear_size = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] QuobyteHD.volumes_dir = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_notifications.driver = [] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_notifications.retry = -1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] key_manager.fixed_key = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.barbican_api_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.barbican_endpoint = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.barbican_endpoint_type = public {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.barbican_region_name = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.number_of_retries = 60 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.retry_delay = 1 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.send_service_user_token = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.tls_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.tls_min_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.verify_ssl = True {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican.verify_ssl_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.auth_section = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.auth_type = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.cafile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.certfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.collect_timing = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.insecure = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.keyfile = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.split_loggers = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.timeout = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.tls_ciphers = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] barbican_service_user.tls_min_version = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.approle_role_id = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.approle_secret_id = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.auth_method = approle {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.auth_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.kv_mountpoint = secret {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.kv_path = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.kv_version = 2 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.namespace = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.root_token_id = **** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.ssl_ca_crt_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.timeout = 60.0 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.token_file = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.token_role = None {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.use_ssl = False {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:10:48 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] ******************************************************************************** {{(pid=86214) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:10:49 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.444s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:49 devstack cinder-volume[86458]: INFO cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 succeeded Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=86458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.457s {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:49 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:10:49 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:49 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.278s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:49 devstack cinder-volume[86458]: INFO cinder.volume.driver [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG cinder.volume.driver [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5189056396484, 'free_capacity_gb': 1775.5189056396484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86458) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_db.sqlalchemy.engines [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86458) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG dbcounter [-] [86458] Writer thread running {{(pid=86458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG cinder.db.api [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Building query based on filter {{(pid=86458) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4158}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG cinder.image.image_utils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86458) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:10:49 devstack cinder-volume[86458]: INFO cinder.keymgr.migration [None req-69607403-33a7-4af4-aff8-ee85f7b77a8d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=86458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=86458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:49 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:10:49 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:49 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.242s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG cinder.manager [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Notifying Schedulers of capabilities ... {{(pid=86458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:49 devstack cinder-volume[86458]: INFO cinder.volume.manager [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Driver initialization completed successfully. Sep 23 00:10:49 devstack cinder-volume[86458]: INFO cinder.manager [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Initiating service 3 cleanup Sep 23 00:10:49 devstack cinder-volume[86458]: INFO cinder.manager [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Service 3 cleanup completed. Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG cinder.service [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Creating RPC server for service cinder-volume {{(pid=86458) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:10:49 devstack cinder-volume[86458]: DEBUG cinder.service [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86458) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:10:50 devstack cinder-volume[86458]: INFO cinder.volume.manager [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:10:50 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:50 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:50 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=86458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:50 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.quobyte [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=86458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:50 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:50 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:50 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:10:50 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:50 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:50 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.302s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:50 devstack cinder-volume[86458]: INFO cinder.volume.manager [None req-a110193b-2b67-4e70-8f52-7789d4b003be None None] Driver post RPC initialization completed successfully. Sep 23 00:10:55 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-7d12d4ca-a0a9-440c-8dfb-a1f1f70b66a2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:10:55 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-7d12d4ca-a0a9-440c-8dfb-a1f1f70b66a2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:10:55 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.quobyte [None req-7d12d4ca-a0a9-440c-8dfb-a1f1f70b66a2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=86458) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:10:55 devstack cinder-volume[86458]: DEBUG cinder.volume.drivers.quobyte [None req-7d12d4ca-a0a9-440c-8dfb-a1f1f70b66a2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=86458) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:10:55 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-7d12d4ca-a0a9-440c-8dfb-a1f1f70b66a2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86458) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:10:55 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-7d12d4ca-a0a9-440c-8dfb-a1f1f70b66a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:10:55 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:10:55 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:10:55 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Sep 23 00:10:55 devstack cinder-volume[86458]: DEBUG oslo_concurrency.processutils [None req-7d12d4ca-a0a9-440c-8dfb-a1f1f70b66a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.250s {{(pid=86458) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:10:55 devstack cinder-volume[86458]: DEBUG cinder.manager [None req-7d12d4ca-a0a9-440c-8dfb-a1f1f70b66a2 None None] Notifying Schedulers of capabilities ... {{(pid=86458) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:10:58 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Caught SIGTERM, stopping children Sep 23 00:10:58 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Acquiring lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:10:58 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Acquired lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:10:58 devstack cinder-volume[86214]: DEBUG oslo_concurrency.lockutils [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Releasing lock "singleton_lock" {{(pid=86214) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:10:58 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Stop services. {{(pid=86214) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 23 00:10:58 devstack cinder-volume[86214]: DEBUG oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Killing children. {{(pid=86214) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 23 00:10:58 devstack cinder-volume[86214]: INFO oslo_service.backend._eventlet.service [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Waiting on 1 children to exit Sep 23 00:11:00 devstack cinder-volume[86458]: DEBUG dbcounter [-] [86458] Writing DB stats cinder:SELECT=4 {{(pid=86458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:00 devstack cinder-volume[86458]: DEBUG dbcounter [-] [86458] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86458) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:03 devstack cinder-volume[86458]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 23 00:11:03 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Acquiring lock "singleton_lock" {{(pid=86458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:11:03 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Acquired lock "singleton_lock" {{(pid=86458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:11:03 devstack cinder-volume[86458]: DEBUG oslo_concurrency.lockutils [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Releasing lock "singleton_lock" {{(pid=86458) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:11:03 devstack cinder-volume[86458]: WARNING amqp [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:11:03 devstack cinder-volume[86458]: WARNING amqp [None req-6937abef-986b-4a2f-9dc4-ba4f75b549f0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 23 00:11:03 devstack cinder-volume[86834]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 23 00:11:03 devstack cinder-volume[86834]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:11:03 devstack cinder-volume[86834]: we strongly recommend against using it for new projects. Sep 23 00:11:03 devstack cinder-volume[86834]: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:11:03 devstack cinder-volume[86834]: framework. For more detail see Sep 23 00:11:03 devstack cinder-volume[86834]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:11:03 devstack cinder-volume[86834]: import eventlet # noqa Sep 23 00:11:06 devstack cinder-volume[86834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86834) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 23 00:11:06 devstack cinder-volume[86834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86834) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 23 00:11:06 devstack cinder-volume[86834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86834) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 23 00:11:07 devstack cinder-volume[86834]: INFO dbcounter [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Registered counter for database cinder Sep 23 00:11:07 devstack cinder-volume[86834]: DEBUG oslo_db.sqlalchemy.engines [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86834) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:11:07 devstack cinder-volume[86834]: DEBUG dbcounter [-] [86834] Writer thread running {{(pid=86834) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:11:07 devstack cinder-volume[86834]: INFO cinder.rpc [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 23 00:11:07 devstack cinder-volume[86834]: INFO cinder.rpc [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_db.sqlalchemy.engines [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86834) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:11:08 devstack cinder-volume[86834]: INFO cinder.volume.manager [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Determined volume DB was empty at startup. Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG cinder.volume.manager [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86834) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 23 00:11:08 devstack cinder-volume[86834]: WARNING stevedore.named [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 23 00:11:08 devstack cinder-volume[86834]: WARNING castellan.key_manager [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:11:08 devstack cinder-volume[86834]: WARNING cinder.keymgr.conf_key_mgr [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 23 00:11:08 devstack cinder-volume[86834]: INFO cinder.volume.manager [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_db.sqlalchemy.engines [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86834) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:11:08 devstack cinder-volume[86834]: INFO oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Starting 1 workers Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Started child 87138 {{(pid=86834) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Full set of CONF: {{(pid=86834) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] ******************************************************************************** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] Configuration options gathered from: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] ================================================================================ {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] allow_availability_zone_fallback = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] allow_compression_on_image_upload = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] allowed_direct_url_schemes = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] api_rate_limit = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] auth_strategy = keystone {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_host = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_stats_polling_interval = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backup_api_class = cinder.backup.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[87138]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backup_name_template = backup-%s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backup_use_same_host = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backup_use_temp_snapshot = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] chap_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] chap_username = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cinder_internal_tenant_project_id = 2ab177e8077e466294ae426b625c11f1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cinder_internal_tenant_user_id = 5e791e89086a48c381cf4531e3ece8b7 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cluster = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] compression_format = gzip {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] config_dir = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] config_source = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] control_exchange = openstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] debug = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] default_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] default_group_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] default_volume_type = QuobyteHD {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] deployment_max_gigabytes = -1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] disk_geometry = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] driver_client_cert = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] driver_client_cert_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] driver_data_namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] driver_ssl_cert_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] driver_ssl_cert_verify = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] driver_use_ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] enable_new_services = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] enable_unsupported_driver = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] enforce_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] filter_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_api_insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_api_servers = ['http://192.168.122.205/image'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_api_ssl_compression = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_ca_certificates_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_num_retries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance_request_timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] goodness_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] graceful_shutdown_timeout = 5 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] group_api_class = cinder.group.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] host = devstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_compress_on_upload = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_conversion_address_space_limit = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_conversion_cpu_limit = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_conversion_disable = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_introspection_address_space_limit = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_introspection_cpu_limit = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_upload_use_cinder_backend = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_upload_use_internal_tenant = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_volume_cache_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_volume_cache_max_count = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] init_host_max_objects_retrieval = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] instance_format = [instance: %(uuid)s] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] iscsi_target_flags = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] iscsi_write_cache = on {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] iser_helper = tgtadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] iser_ip_address = 192.168.122.205 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] iser_port = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] log_color = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] log_config_append = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] log_dir = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] log_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] log_options = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] log_rotate_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] log_rotate_interval_type = days {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] log_rotation_type = none {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] max_age = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] max_logfile_count = 30 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] max_logfile_size_mb = 200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] max_over_subscription_ratio = 20.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] message_reap_interval = 86400 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] message_ttl = 2592000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] monkey_patch = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] monkey_patch_modules = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] my_ip = 192.168.122.205 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] no_snapshot_gb_quota = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] num_iser_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] num_shell_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] num_volume_device_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] nvmeof_conn_info_version = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] nvmet_ns_id = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] nvmet_port_id = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] osapi_max_limit = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] osapi_volume_ext_list = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] osapi_volume_listen_port = 8776 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] osapi_volume_use_ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] osapi_volume_workers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] per_volume_size_limit = -1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] periodic_fuzzy_delay = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] periodic_interval = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] public_endpoint = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] publish_errors = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87138) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] quota_backup_gigabytes = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] quota_backups = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] quota_gigabytes = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] quota_groups = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] quota_snapshots = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] quota_volumes = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] rate_limit_burst = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] rate_limit_except_level = CRITICAL {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] rate_limit_interval = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] reinit_driver_count = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] replication_device = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] report_discard_supported = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] report_interval = 120 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] reservation_clean_interval = 86400 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] reservation_expire = 86400 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] reserved_image_namespaces = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] reserved_percentage = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] rpc_response_timeout = 120 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] run_external_periodic_tasks = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] scst_target_driver = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] scst_target_iqn_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_down_time = 720 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] shell_completion = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] snapshot_name_template = snapshot-%s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] state_path = /opt/stack/data/cinder {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] storage_availability_zone = nova {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] storage_protocol = iSCSI {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] syslog_log_facility = LOG_USER {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] target_helper = lioadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] target_ip_address = 192.168.122.205 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] target_port = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] target_protocol = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] target_secondary_ip_addresses = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] trace_flags = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] transport_url = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] until_refresh = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] use_chap_auth = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] use_default_quota_class = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] use_journal = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] use_json = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] use_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] use_stderr = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] use_syslog = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] verify_glance_signatures = enabled {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_api_class = cinder.volume.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_backend_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_clear = zero {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_clear_ionice = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_clear_size = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_copy_bps_limit = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_dd_blocksize = 1M {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_name_template = volume-%s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_service_inithost_offload = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volume_usage_audit_period = month {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] zoning_mode = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.auth_type = password {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.auth_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.cache = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.interface = public {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcache_username = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.region_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.service_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.205/identity {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.backend = dogpile.cache.null {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.backend_argument = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.backend_expiration_time = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.config_prefix = cache.oslo {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.debug_cache_backend = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.enable_retry_client = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.enable_socket_keepalive = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.expiration_time = 600 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.memcache_dead_retry = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.memcache_sasl_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.proxies = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.redis_db = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.redis_server = localhost:6379 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.retry_attempts = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.retry_delay = 0.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.socket_keepalive_count = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.socket_keepalive_idle = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.socket_keepalive_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.socket_timeout = 1.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.tls_allowed_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.tls_cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.tls_certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.tls_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.tls_keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cache.username = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] coordination.backend_url = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.asyncio_connection = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.asyncio_slave_connection = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.backend = sqlalchemy {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.connection = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.connection_debug = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.connection_parameters = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.connection_recycle_time = 3600 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.connection_trace = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.db_inc_retry_interval = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.db_max_retries = 20 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.db_max_retry_interval = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.db_retry_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.max_overflow = 50 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.max_pool_size = 5 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.max_retries = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.pool_timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.retry_interval = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.slave_connection = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.sqlite_synchronous = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.synchronous_reader = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] database.use_db_reconnect = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87138) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_tracing.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.quobyte [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.quobyte [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Running cmd (subprocess): mount.quobyte {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.connection_string = messaging:// {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.es_doc_type = notification {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.es_scroll_size = 10000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.es_scroll_time = 2m {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.filter_error_trace = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.hmac_keys = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.sentinel_service_name = mymaster {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.socket_timeout = 0.1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.trace_requests = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler.trace_sqlalchemy = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler_jaeger.process_tags = {} {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] profiler_otlp.service_name_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.policy_default_rule = default {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] privsep_osbrick.group = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] privsep_osbrick.helper_command = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] privsep_osbrick.user = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cinder_sys_admin.group = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cinder_sys_admin.helper_command = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] cinder_sys_admin.user = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.auth_type = password {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.collect_timing = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.send_service_user_token = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.tls_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] service_user.tls_min_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.auth_type = password {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.collect_timing = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.region_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.tls_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] glance.tls_min_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.backend_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.chap_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.chap_username = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.disk_geometry = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.driver_client_cert = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.driver_data_namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.driver_use_ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack quobyte-client[87139]: Reading configuration file: /etc/quobyte/client.cfg Sep 23 00:11:08 devstack quobyte-client[87139]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.extra_capabilities = {} {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.filter_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.goodness_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.iscsi_target_flags = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.iser_ip_address = 192.168.122.205 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.iser_port = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_host = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_login = admin {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_mount_options = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_private_key = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_share_path = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.replication_device = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.report_discard_supported = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.target_helper = tgtadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.target_ip_address = 192.168.122.205 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.target_port = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.target_protocol = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.trace_flags = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.use_chap_auth = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.volume_backend_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.volume_clear = zero {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_reports.file_event_handler = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_reports.log_dir = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.backend_host = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.chap_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.chap_username = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.disk_geometry = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.driver_client_cert = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.extra_capabilities = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.filter_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.goodness_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.iser_helper = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.iser_ip_address = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.iser_port = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_host = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_login = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_mount_options = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_private_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_share_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.num_shell_tries = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.replication_device = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.report_discard_supported = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.reserved_percentage = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.scst_target_driver = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.storage_protocol = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.target_helper = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.target_ip_address = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.target_port = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.target_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.target_protocol = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.trace_flags = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.use_chap_auth = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.volume_clear = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.volume_clear_size = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] QuobyteHD.volumes_dir = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_notifications.driver = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] key_manager.fixed_key = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.barbican_api_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.barbican_endpoint = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.barbican_endpoint_type = public {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.barbican_region_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.collect_timing = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.number_of_retries = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.retry_delay = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.send_service_user_token = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.tls_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.tls_min_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.verify_ssl = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican.verify_ssl_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.auth_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.collect_timing = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.tls_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] barbican_service_user.tls_min_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.approle_role_id = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.approle_secret_id = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.auth_method = approle {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.auth_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.kv_mountpoint = secret {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.kv_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.kv_version = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.root_token_id = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.ssl_ca_crt_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.timeout = 60.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.token_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.token_role = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.use_ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 23 00:11:08 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-38fb36ca-a387-453c-9887-dfbd3e65d0c1 None None] ******************************************************************************** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 23 00:11:08 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.283s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:08 devstack cinder-volume[87138]: INFO cinder.volume.driver [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Driver hasn't implemented _init_vendor_properties() Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG cinder.volume.driver [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5189056396484, 'free_capacity_gb': 1775.5189056396484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87138) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_db.sqlalchemy.engines [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87138) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writer thread running {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG cinder.db.api [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Building query based on filter {{(pid=87138) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:4158}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87138) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:08 devstack cinder-volume[87138]: INFO cinder.keymgr.migration [None req-66c996f5-02d9-47ff-ba29-a71e56365646 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 23 00:11:08 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:11:08 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:09 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.291s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:11:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Driver initialization completed successfully. Sep 23 00:11:09 devstack cinder-volume[87138]: INFO cinder.manager [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Initiating service 3 cleanup Sep 23 00:11:09 devstack cinder-volume[87138]: INFO cinder.manager [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Service 3 cleanup completed. Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG cinder.service [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Creating RPC server for service cinder-volume {{(pid=87138) start /opt/stack/cinder/cinder/service.py:231}} Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG cinder.service [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87138) start /opt/stack/cinder/cinder/service.py:237}} Sep 23 00:11:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:11:09 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:11:09 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:11:09 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Sep 23 00:11:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.260s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:11:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b587ce97-6cfa-45d2-b484-bfc8db9ff81d None None] Driver post RPC initialization completed successfully. Sep 23 00:11:18 devstack cinder-volume[86834]: DEBUG dbcounter [-] [86834] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86834) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=3 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:11:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-74801bc7-7ba7-4cdc-a002-f5f75f8f3b6a tempest-BackendsCapabilitiesAdminTestsJSON-1445402518 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5189056396484, 'free_capacity_gb': 1775.5189056396484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87138) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:11:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a536a317-9883-4383-8137-e9775bd5792f tempest-BackendsCapabilitiesAdminTestsJSON-1445402518 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5189056396484, 'free_capacity_gb': 1775.5189056396484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87138) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:12:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:12:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 6 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:12:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:12:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2e1b06cf-64ec-433e-94f0-7eecdf69e8e7 tempest-GroupsV320Test-10191458 None] Group tempest-GroupsV320Test-Group-612901352: creating Sep 23 00:12:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2e1b06cf-64ec-433e-94f0-7eecdf69e8e7 tempest-GroupsV320Test-10191458 None] Group tempest-GroupsV320Test-Group-612901352: created successfully Sep 23 00:12:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2e1b06cf-64ec-433e-94f0-7eecdf69e8e7 tempest-GroupsV320Test-10191458 None] Create group completed successfully. Sep 23 00:12:10 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] Created reservations ['887c081a-3bc2-4847-88c8-243522c66684'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:12:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:10 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:12:10 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:11 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.440s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:11 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:11 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-942d0d10-4558-4ea8-b495-2390f3aec3fb tempest-GroupsV320Test-10191458 None] Delete group completed successfully. Sep 23 00:12:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Flow 'volume_create_manager' (7333b585-cb61-45bb-a8f0-e2b4d3dce49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09f8cc0-58e4-4669-9786-23a03fad527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b09f8cc0-58e4-4669-9786-23a03fad527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1506555350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb45cb7-d389-4491-8798-9d84afd220db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f3c39fab7b4580a2cd0beefff24fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:24Z,use_quota=True,user_id='5faae619881a433b93d16d89ff5e8b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bace97b9-4abf-4999-89e1-1587816dea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bace97b9-4abf-4999-89e1-1587816dea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c97cdb-eb40-4863-97c6-0d599733aaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c97cdb-eb40-4863-97c6-0d599733aaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bb45cb7-d389-4491-8798-9d84afd220db', 'volume_name': 'volume-7bb45cb7-d389-4491-8798-9d84afd220db', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621ec09f-3da1-4635-aa5b-56c011cd904f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621ec09f-3da1-4635-aa5b-56c011cd904f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4512a-0191-4c10-b35e-92409a94fe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Volume 7bb45cb7-d389-4491-8798-9d84afd220db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bb45cb7-d389-4491-8798-9d84afd220db', 'volume_size': 1} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1506555350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb45cb7-d389-4491-8798-9d84afd220db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51f3c39fab7b4580a2cd0beefff24fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:24Z,use_quota=True,user_id='5faae619881a433b93d16d89ff5e8b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Creating volume 7bb45cb7-d389-4491-8798-9d84afd220db {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:24 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:12:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:24 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db 1073741824 Sep 23 00:12:24 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:25 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db 1073741824" returned: 0 in 1.040s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:25 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db Sep 23 00:12:25 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:26 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db" returned: 0 in 0.503s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4512a-0191-4c10-b35e-92409a94fe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb45cb7-d389-4491-8798-9d84afd220db', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce0a46-76dd-421c-8bd2-b695d105b437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Volume volume-7bb45cb7-d389-4491-8798-9d84afd220db (7bb45cb7-d389-4491-8798-9d84afd220db): created successfully Sep 23 00:12:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce0a46-76dd-421c-8bd2-b695d105b437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Flow 'volume_create_manager' (7333b585-cb61-45bb-a8f0-e2b4d3dce49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a45e96e6-fbca-4061-b814-9fb958608a0e tempest-DeleteServersTestJSON-2066936363 None] Created volume successfully. Sep 23 00:12:32 devstack cinder-volume[87138]: WARNING py.warnings [req-4f7f2c4b-5e73-4b22-bdce-56ba00b916ae req-bcd873bd-1881-49bb-ad7e-0d0b3fabb8cd tempest-DeleteServersTestJSON-2066936363 None] /opt/stack/cinder/cinder/db/api.py:2684: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 23 00:12:32 devstack cinder-volume[87138]: .first() Sep 23 00:12:32 devstack cinder-volume[87138]: Sep 23 00:12:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-4f7f2c4b-5e73-4b22-bdce-56ba00b916ae req-bcd873bd-1881-49bb-ad7e-0d0b3fabb8cd tempest-DeleteServersTestJSON-2066936363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-4f7f2c4b-5e73-4b22-bdce-56ba00b916ae req-bcd873bd-1881-49bb-ad7e-0d0b3fabb8cd tempest-DeleteServersTestJSON-2066936363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-4f7f2c4b-5e73-4b22-bdce-56ba00b916ae req-bcd873bd-1881-49bb-ad7e-0d0b3fabb8cd tempest-DeleteServersTestJSON-2066936363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-4f7f2c4b-5e73-4b22-bdce-56ba00b916ae req-bcd873bd-1881-49bb-ad7e-0d0b3fabb8cd tempest-DeleteServersTestJSON-2066936363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-7bb45cb7-d389-4491-8798-9d84afd220db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05949e4e-6128-4760-bfd4-79a9bf9724a8', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:12:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-4f7f2c4b-5e73-4b22-bdce-56ba00b916ae req-bcd873bd-1881-49bb-ad7e-0d0b3fabb8cd tempest-DeleteServersTestJSON-2066936363 None] attachment_update completed successfully. Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Flow 'volume_create_manager' (cad51d52-a09d-4b90-ac6f-d1cd489e22b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be68224b-21c6-428d-98a2-08aabf484b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be68224b-21c6-428d-98a2-08aabf484b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1632243614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b59e18-8eb3-4ce7-af9a-6845de1dde88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab88185d5d07498ebacdd9868b4df247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:37Z,use_quota=True,user_id='4a6964d51ef44e43856bd582234df77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e158fab5-2301-4f4f-87db-49c6870d3401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e158fab5-2301-4f4f-87db-49c6870d3401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36402735-64e5-42d9-aa33-2fdad0929af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36402735-64e5-42d9-aa33-2fdad0929af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b59e18-8eb3-4ce7-af9a-6845de1dde88', 'volume_name': 'volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b92f88-9ba0-4e62-ad0c-91bf29a8e9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b92f88-9ba0-4e62-ad0c-91bf29a8e9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40fe29a-2ae9-4aa7-8253-b0f23b0affb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:36 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88', 'volume_size': 1} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1632243614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b59e18-8eb3-4ce7-af9a-6845de1dde88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab88185d5d07498ebacdd9868b4df247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:37Z,use_quota=True,user_id='4a6964d51ef44e43856bd582234df77e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Creating volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:36 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:12:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:36 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 1073741824 Sep 23 00:12:36 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:37 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 1073741824" returned: 0 in 0.615s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:37 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 Sep 23 00:12:37 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:37 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88" returned: 0 in 0.334s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e40fe29a-2ae9-4aa7-8253-b0f23b0affb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c1c1da-afb6-4283-af80-2aa796d68c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:38 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Volume volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 (33b59e18-8eb3-4ce7-af9a-6845de1dde88): created successfully Sep 23 00:12:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c1c1da-afb6-4283-af80-2aa796d68c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Flow 'volume_create_manager' (cad51d52-a09d-4b90-ac6f-d1cd489e22b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:38 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-65b12a85-ffe4-4ed5-92a0-6c8f181b11cf tempest-SnapshotsActionsTest-905705412 None] Created volume successfully. Sep 23 00:12:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Creating offline snapshot 0995c4c2-d178-4879-af7c-354e1b65997a of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:12:39 devstack cinder-volume[87138]: INFO oslo.privsep.daemon [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm86ipdp3/privsep.sock'] Sep 23 00:12:39 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm86ipdp3/privsep.sock Sep 23 00:12:39 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-d8179847-0432-4cd6-bf43-5583278668a5 req-aa2f352c-25b4-4c4d-9468-807f997ae6f7 tempest-DeleteServersTestJSON-2066936363 None] Terminate volume connection completed successfully. Sep 23 00:12:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-d8179847-0432-4cd6-bf43-5583278668a5 req-aa2f352c-25b4-4c4d-9468-807f997ae6f7 tempest-DeleteServersTestJSON-2066936363 None] Deleting attachment 05949e4e-6128-4760-bfd4-79a9bf9724a8. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:12:40 devstack cinder-volume[87138]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 23 00:12:40 devstack cinder-volume[87138]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 23 00:12:40 devstack cinder-volume[87138]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 23 00:12:40 devstack cinder-volume[87138]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:12:40 devstack cinder-volume[87138]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 23 00:12:40 devstack cinder-volume[87138]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 23 00:12:40 devstack cinder-volume[87138]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 23 00:12:41 devstack cinder-volume[87138]: WARNING oslo.privsep.daemon [-] privsep log: Sep 23 00:12:41 devstack cinder-volume[87138]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 23 00:12:41 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:41 devstack cinder-volume[87138]: INFO oslo.privsep.daemon [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Spawned new privsep daemon via rootwrap Sep 23 00:12:41 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Accepted privsep connection to /tmp/tmpm86ipdp3/privsep.sock {{(pid=87138) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 23 00:12:41 devstack cinder-volume[87138]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 23 00:12:41 devstack cinder-volume[87138]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 23 00:12:41 devstack cinder-volume[87138]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 23 00:12:41 devstack cinder-volume[87138]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88568 Sep 23 00:12:41 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[442a1907-4a74-48d7-bc31-062e1510454e]: (2,) {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:41 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f939553-fffb-4d44-bfcb-b54aef98fc6f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:41 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 Sep 23 00:12:41 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:41 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88" returned: 0 in 0.500s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:41 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a 1G Sep 23 00:12:41 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:42 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a 1G" returned: 0 in 0.577s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:42 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:12:42 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:43 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 1.035s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:43 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a is being set with open permissions: ugo+rw Sep 23 00:12:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:43 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:12:43 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Acquiring lock "cinder-7bb45cb7-d389-4491-8798-9d84afd220db-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Lock "cinder-7bb45cb7-d389-4491-8798-9d84afd220db-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Acquiring lock "cinder-quobyte-7bb45cb7-d389-4491-8798-9d84afd220db" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Lock "cinder-quobyte-7bb45cb7-d389-4491-8798-9d84afd220db" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[220aadb5-209b-47ba-a6c0-3e99f37d8709]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.766s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db Sep 23 00:12:44 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:44 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.info Sep 23 00:12:44 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:44 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db" returned: 0 in 0.717s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:44 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db Sep 23 00:12:44 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:44 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.info" returned: 0 in 0.616s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:44 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.info is being set with open permissions: ugo+rw Sep 23 00:12:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:45 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.info Sep 23 00:12:45 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:45 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7bb45cb7-d389-4491-8798-9d84afd220db" returned: 0 in 0.704s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Lock "cinder-quobyte-7bb45cb7-d389-4491-8798-9d84afd220db" released by "delete_volume" :: held 1.530s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.info" returned: 0 in 0.650s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.258s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:46 devstack cinder-volume[87138]: WARNING cinder.quota [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:12:46 devstack cinder-volume[87138]: WARNING cinder.quota [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:12:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-7551493f-0c70-4886-9524-63ff1c7dfbeb tempest-SnapshotsActionsTest-905705412 None] Create snapshot completed successfully Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Created reservations ['a0d99ff4-85cc-4fae-9493-7990d1e1788f', 'bc12c17b-0c2a-41cf-ba11-b413f5b2f3c5', '583e13f4-7511-4ded-9666-f4edbe3e1163', 'a2532784-e81c-417d-b8ce-4ea210317753', 'b29389a6-18ba-44c8-a2ec-cbaf91247b98'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:46 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:12:46 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:46 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.423s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Deleted volume successfully. Sep 23 00:12:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5be219c8-60ea-4745-a5cb-2f3d562ce573 tempest-DeleteServersTestJSON-2066936363 None] Lock "cinder-7bb45cb7-d389-4491-8798-9d84afd220db-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Creating offline snapshot 9ece6b52-ac35-432e-8315-56b95cd27591 of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:12:48 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac01e20-70b7-41ed-b074-11b5514b6183]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:48 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:12:48 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:48 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.615s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:12:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:49 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 1G Sep 23 00:12:49 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:49 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 1G" returned: 0 in 0.792s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:49 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 Sep 23 00:12:49 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Flow 'volume_create_manager' (13e941bb-56fd-4385-8b20-913905b59101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7505ff-f804-425f-beb1-5cfb960a523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7505ff-f804-425f-beb1-5cfb960a523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2073218632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99da972b3fbc4ab7828c4096683d3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:50Z,use_quota=True,user_id='c1f0d0d9ca974eddbd7cdf34557372a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d4dbe2-6ee9-4519-8888-62b26dcf4981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d4dbe2-6ee9-4519-8888-62b26dcf4981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be591fe5-9a6d-4bc2-aa19-aca1e45d2716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be591fe5-9a6d-4bc2-aa19-aca1e45d2716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d', 'volume_name': 'volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc72f7c5-85cb-43ad-8191-74c373a93da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc72f7c5-85cb-43ad-8191-74c373a93da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ebfc93-5326-474c-9baa-e02dccac8994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:50 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Volume 00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d', 'volume_size': 1} Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:50 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591" returned: 0 in 0.735s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:50 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 is being set with open permissions: ugo+rw Sep 23 00:12:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:50 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 Sep 23 00:12:50 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:51 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591" returned: 0 in 0.628s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.966s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2073218632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99da972b3fbc4ab7828c4096683d3fe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:12:50Z,use_quota=True,user_id='c1f0d0d9ca974eddbd7cdf34557372a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Creating volume 00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:12:51 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:51 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d 1073741824 Sep 23 00:12:51 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-109c2bb3-65e1-4475-9a4a-56a92e031826 tempest-SnapshotsActionsTest-905705412 None] Create snapshot completed successfully Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-9ece6b52-ac35-432e-8315-56b95cd27591-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-9ece6b52-ac35-432e-8315-56b95cd27591-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-quobyte-9ece6b52-ac35-432e-8315-56b95cd27591" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-9ece6b52-ac35-432e-8315-56b95cd27591" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Deleting offline snapshot 9ece6b52-ac35-432e-8315-56b95cd27591 of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] snapshot_file for this snap is: volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:12:52 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d 1073741824" returned: 0 in 0.748s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[185451fc-2042-4f9c-a0df-af72352cbeff]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:52 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d Sep 23 00:12:52 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:52 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 Sep 23 00:12:52 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:52 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591" returned: 0 in 0.640s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:12:52 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d" returned: 0 in 0.700s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b0be15-9c7e-43f7-9326-459393f6253d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ebfc93-5326-474c-9baa-e02dccac8994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d967e4a-b6f8-4489-af11-dddec0d3fcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:12:52 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Volume volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d (00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d): created successfully Sep 23 00:12:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d967e4a-b6f8-4489-af11-dddec0d3fcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:12:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Flow 'volume_create_manager' (13e941bb-56fd-4385-8b20-913905b59101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:12:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-7574a81d-912b-454d-afe6-a9653f701d56 tempest-VolumesAdminNegativeTest-1555444958 None] Created volume successfully. Sep 23 00:12:53 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:12:53 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:53 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.867s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:12:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:53 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 Sep 23 00:12:53 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Acquiring lock "cinder-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:54 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591" returned: 0 in 0.774s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:54 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591 Sep 23 00:12:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "cinder-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:54 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Acquiring lock "cinder-quobyte-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:12:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "cinder-quobyte-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d" acquired by "delete_volume" :: waited 0.041s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:12:54 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6eee7f-9891-49a4-8a2b-8e6364b46db6]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:55 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.9ece6b52-ac35-432e-8315-56b95cd27591" returned: 0 in 0.603s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-9ece6b52-ac35-432e-8315-56b95cd27591" released by "_delete_snapshot" :: held 3.199s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" released by "delete_snapshot" :: held 3.268s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:55 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d Sep 23 00:12:55 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:55 devstack cinder-volume[87138]: WARNING cinder.quota [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:12:55 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Created reservations ['3e56dec4-f338-4150-931a-9955a6cff77e', 'f2ce68b2-38cd-49ba-ad7a-0254e6960ab1', 'db4eaeb9-c1f3-44e2-ad18-463ce950c242', 'b10f9215-3341-4453-8c90-e859e18e10fe', 'cdca776a-615b-443e-a975-f7454d78db29'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:12:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Delete snapshot completed successfully. Sep 23 00:12:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6910ef3-9eb2-4822-9fc7-265c1e421502 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-9ece6b52-ac35-432e-8315-56b95cd27591-delete_snapshot" released by "delete_snapshot" :: held 3.701s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:55 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d" returned: 0 in 1.099s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:55 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d Sep 23 00:12:55 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:56 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d" returned: 0 in 0.365s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "cinder-quobyte-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d" released by "delete_volume" :: held 1.538s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:56 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Created reservations ['0a31de70-5fe7-4a16-a6ec-b65357b048e6', '7c241247-d36b-41c9-b0b7-4afbee265e8b', 'e46776ec-bd59-4e7b-9d97-e501af84acdb', '2d7df06f-78a7-4a73-972f-638c68c5e87b', 'f464ffe6-28b6-43e0-ae5a-acf2fa9025d8'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:12:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:12:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:12:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:12:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:56 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:12:56 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:57 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.588s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:57 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:12:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Deleted volume successfully. Sep 23 00:12:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cb1497c4-41c6-4597-9be7-dbf515a084c6 tempest-VolumesAdminNegativeTest-1555444958 None] Lock "cinder-00d0dc58-8d5e-4f97-ab69-c03ca9bbef8d-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:12:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:12:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:12:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Creating offline snapshot b66c61de-7a93-408f-8b3b-b7f3fb800ae9 of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:12:57 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[816c6aa4-0f3f-4d5a-bddc-32efc81fb623]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:12:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:57 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:12:57 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:58 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.879s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:12:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:58 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 1G Sep 23 00:12:58 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:59 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 1G" returned: 0 in 0.931s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:59 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 Sep 23 00:12:59 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:12:59 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Sep 23 00:12:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9" returned: 0 in 0.623s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:12:59 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 is being set with open permissions: ugo+rw Sep 23 00:12:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:12:59 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 Sep 23 00:12:59 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:00 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9" returned: 0 in 0.381s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.039s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:00 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c191ecdc-9f52-4fd1-b0c2-3615cae132ec tempest-SnapshotsActionsTest-905705412 None] Create snapshot completed successfully Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-b66c61de-7a93-408f-8b3b-b7f3fb800ae9-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-b66c61de-7a93-408f-8b3b-b7f3fb800ae9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-quobyte-b66c61de-7a93-408f-8b3b-b7f3fb800ae9" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-b66c61de-7a93-408f-8b3b-b7f3fb800ae9" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Deleting offline snapshot b66c61de-7a93-408f-8b3b-b7f3fb800ae9 of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:13:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] snapshot_file for this snap is: volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:13:01 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abf5282-82cc-40ad-8ea5-407b23a00737]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:01 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 Sep 23 00:13:01 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:01 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9" returned: 0 in 0.741s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:01 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd48fac-5bd8-401b-803f-b4b55e196600]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:02 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:13:02 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:02 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.645s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:02 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 Sep 23 00:13:02 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:02 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:13:02 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:03 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.510s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 8 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:13:03 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9" returned: 0 in 0.770s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:03 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9 Sep 23 00:13:03 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:03 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.b66c61de-7a93-408f-8b3b-b7f3fb800ae9" returned: 0 in 0.345s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-b66c61de-7a93-408f-8b3b-b7f3fb800ae9" released by "_delete_snapshot" :: held 2.701s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" released by "delete_snapshot" :: held 2.751s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Created reservations ['7856bb9c-93a6-4d2d-98e5-1b410822470a', '42427b79-418b-4f97-97e7-1804e83a3373', '6ab285f4-4140-4176-9a53-37891f3d6b20', '1399de36-78c1-4275-8f10-789dbf83519b', '6e9be48d-9a84-4914-9163-c5fa9e643a6b'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:13:03 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Delete snapshot completed successfully. Sep 23 00:13:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ef952a83-b623-443f-96ba-a035e0b873c4 tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-b66c61de-7a93-408f-8b3b-b7f3fb800ae9-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Creating offline snapshot 720ed787-55ab-4332-8c07-2a46b2fb489c of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:13:04 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[233c36d6-5c87-4f6c-9378-6ec4a3952f54]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:04 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:13:04 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:05 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.590s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:05 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c 1G Sep 23 00:13:05 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:05 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c 1G" returned: 0 in 0.580s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:05 devstack sudo[88874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c Sep 23 00:13:05 devstack sudo[88874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:06 devstack sudo[88874]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c" returned: 0 in 0.443s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:06 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c is being set with open permissions: ugo+rw Sep 23 00:13:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:06 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c Sep 23 00:13:06 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:06 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c" returned: 0 in 0.291s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9f474e25-c128-4a3e-af41-a37622f67a5d tempest-SnapshotsActionsTest-905705412 None] Create snapshot completed successfully Sep 23 00:13:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-720ed787-55ab-4332-8c07-2a46b2fb489c-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-720ed787-55ab-4332-8c07-2a46b2fb489c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-quobyte-720ed787-55ab-4332-8c07-2a46b2fb489c" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-720ed787-55ab-4332-8c07-2a46b2fb489c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Deleting offline snapshot 720ed787-55ab-4332-8c07-2a46b2fb489c of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] snapshot_file for this snap is: volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fac065-e45f-4b6e-bf92-6b8f9c748137]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:08 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c Sep 23 00:13:08 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:08 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c" returned: 0 in 0.417s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ac9234-5b93-43a9-b0b3-30d36b3b841c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:08 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:13:08 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:09 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.562s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:09 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c Sep 23 00:13:09 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:09 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c" returned: 0 in 0.504s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:09 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c Sep 23 00:13:09 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:09 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.720ed787-55ab-4332-8c07-2a46b2fb489c" returned: 0 in 0.354s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-720ed787-55ab-4332-8c07-2a46b2fb489c" released by "_delete_snapshot" :: held 1.984s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" released by "delete_snapshot" :: held 2.020s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:10 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Created reservations ['2ca43942-dea8-4f67-b11f-8a4e8e43a0ac', 'ecdcaf32-b4d0-4192-8ea2-36f626be9b4c', '311ed6a9-dbb9-4465-a750-41df2c536e18', 'b60778a4-b100-4c6a-9655-9f4cbd03241f', '3e9168ae-f16e-43c5-a9ef-1925461fa905'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:13:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Delete snapshot completed successfully. Sep 23 00:13:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-43f5591c-dcd5-4834-a0b7-6c0a8bd7cf5b tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-720ed787-55ab-4332-8c07-2a46b2fb489c-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Creating offline snapshot e6283743-12ae-4003-892d-ad4f3a053335 of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:13:11 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a879b1e-b2be-4da3-a0c5-28668a5a2726]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:11 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:13:11 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:12 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.531s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:12 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 1G Sep 23 00:13:12 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:12 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 1G" returned: 0 in 0.626s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:12 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 Sep 23 00:13:12 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:13 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335" returned: 0 in 0.443s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:13 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 is being set with open permissions: ugo+rw Sep 23 00:13:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:13 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 Sep 23 00:13:13 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:13 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335" returned: 0 in 0.351s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:13 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-aac81b5a-b73d-4354-ae8f-1763eadd3c7f tempest-SnapshotsActionsTest-905705412 None] Create snapshot completed successfully Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-e6283743-12ae-4003-892d-ad4f3a053335-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-e6283743-12ae-4003-892d-ad4f3a053335-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Acquiring lock "cinder-quobyte-e6283743-12ae-4003-892d-ad4f3a053335" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-e6283743-12ae-4003-892d-ad4f3a053335" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Deleting offline snapshot e6283743-12ae-4003-892d-ad4f3a053335 of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] snapshot_file for this snap is: volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb036f8f-0709-4d3d-a4c5-af3671a3a3a1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:15 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 Sep 23 00:13:15 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:15 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335" returned: 0 in 0.494s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0c6a94-614f-4289-a12e-4d98113f3a11]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:15 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:13:15 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:16 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.567s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:16 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 Sep 23 00:13:16 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:16 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335" returned: 0 in 0.530s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:16 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335 Sep 23 00:13:16 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:17 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.e6283743-12ae-4003-892d-ad4f3a053335" returned: 0 in 0.478s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-e6283743-12ae-4003-892d-ad4f3a053335" released by "_delete_snapshot" :: held 2.274s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" released by "delete_snapshot" :: held 2.310s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:17 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Created reservations ['abd39dc2-92b7-4101-a59b-d6aef55706b7', '7c29d299-49ea-4612-961a-2f6c192bca53', '5b03508a-ef36-43dd-8d8f-abfff66d6a9e', 'f3d0effb-466d-4915-8397-fd3fa0d49899', 'ca76c25d-6c1e-468b-9117-aba2a2b2b9a7'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:13:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Delete snapshot completed successfully. Sep 23 00:13:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bf25f32f-f448-4798-b0d5-dc5f9d771a6c tempest-SnapshotsActionsTest-1432223633 None] Lock "cinder-e6283743-12ae-4003-892d-ad4f3a053335-delete_snapshot" released by "delete_snapshot" :: held 2.620s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "cinder-0995c4c2-d178-4879-af7c-354e1b65997a-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-0995c4c2-d178-4879-af7c-354e1b65997a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "cinder-quobyte-0995c4c2-d178-4879-af7c-354e1b65997a" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-quobyte-0995c4c2-d178-4879-af7c-354e1b65997a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Deleting offline snapshot 0995c4c2-d178-4879-af7c-354e1b65997a of volume 33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] snapshot_file for this snap is: volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4de9e9-17fa-4e6c-be4e-58b438d6437b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:19 devstack sudo[88954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:13:19 devstack sudo[88954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:19 devstack sudo[88954]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.470s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[970bb86f-4a4d-4f95-976b-bdde52841693]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:19 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 Sep 23 00:13:19 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:20 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88" returned: 0 in 0.484s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:20 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:13:20 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:20 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.436s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:20 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a Sep 23 00:13:20 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:20 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88.0995c4c2-d178-4879-af7c-354e1b65997a" returned: 0 in 0.310s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=64,cinder:UPDATE=66,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=61,cinder:UPDATE=55,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-quobyte-0995c4c2-d178-4879-af7c-354e1b65997a" released by "_delete_snapshot" :: held 1.952s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" released by "delete_snapshot" :: held 1.998s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:21 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Created reservations ['ba40047d-e168-4679-8883-e5d2343f09ec', 'b0b223aa-4e9d-4a5d-9e35-39bb84152a5e', '3c9a1146-7d41-4bde-88cd-acb6df557c46', '370e396b-d0c1-4329-b495-80a6f301030b', 'd4187a7c-2716-4f7a-95f7-4c30f28dd78b'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:13:21 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Delete snapshot completed successfully. Sep 23 00:13:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a9c68c4-3629-48b8-8d0c-397e0786c054 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-0995c4c2-d178-4879-af7c-354e1b65997a-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "cinder-33b59e18-8eb3-4ce7-af9a-6845de1dde88-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-33b59e18-8eb3-4ce7-af9a-6845de1dde88-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:13:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:13:22 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f16fa-1b9d-4df2-8376-d4fa59b2b2c4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:13:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:22 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 Sep 23 00:13:22 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:22 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88" returned: 0 in 0.435s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:23 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88 Sep 23 00:13:23 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:23 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-33b59e18-8eb3-4ce7-af9a-6845de1dde88" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-quobyte-33b59e18-8eb3-4ce7-af9a-6845de1dde88" released by "delete_volume" :: held 0.847s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:23 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Created reservations ['575b3aea-3e5d-4764-9be1-a7e91082df22', 'bf643c23-4cf5-469a-844e-d0201f09c1de', 'f5c03160-8531-49d8-8b08-2bf3ef2cde52', '5438c246-3d05-47ac-ab1e-6426bd1e1717', '9284e20f-4290-43ef-9d52-ca534c37934a'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:13:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:13:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:13:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:13:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:13:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:13:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:13:23 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:13:23 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:13:24 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Sep 23 00:13:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.422s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:13:24 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:13:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Deleted volume successfully. Sep 23 00:13:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1317f9c7-cc45-4548-a0ca-0c53a1d70859 tempest-SnapshotsActionsTest-905705412 None] Lock "cinder-33b59e18-8eb3-4ce7-af9a-6845de1dde88-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:13:33 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=19 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:13:34 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=10,cinder:INSERT=6,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:02 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:14:02 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:04 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 1.277s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:04 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:04 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:14:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 8 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:14:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Flow 'volume_create_manager' (f8e6c3da-6be2-47fa-b892-9433ec36b618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e67b527-3f1e-4fb2-9c47-bdadb5e07f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e67b527-3f1e-4fb2-9c47-bdadb5e07f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-572275061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833edb6f-57e8-4b5d-81ab-8a4328e1efa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6747baa85f84ad9ab98a895a157dc43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:16Z,use_quota=True,user_id='454e3874e69044969a9cef082a82bb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a18db4-d376-4f9b-b00a-6c5f192da0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a18db4-d376-4f9b-b00a-6c5f192da0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db56323d-4f78-42dc-85bb-f7507f31d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db56323d-4f78-42dc-85bb-f7507f31d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '833edb6f-57e8-4b5d-81ab-8a4328e1efa4', 'volume_name': 'volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3907ab94-4a59-4524-b87b-527c24249f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3907ab94-4a59-4524-b87b-527c24249f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0670d6d4-aa15-47a4-8545-8629826f5432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:15 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Volume 833edb6f-57e8-4b5d-81ab-8a4328e1efa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4', 'volume_size': 1} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-572275061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833edb6f-57e8-4b5d-81ab-8a4328e1efa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6747baa85f84ad9ab98a895a157dc43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:16Z,use_quota=True,user_id='454e3874e69044969a9cef082a82bb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Creating volume 833edb6f-57e8-4b5d-81ab-8a4328e1efa4 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:15 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:14:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:16 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 1073741824 Sep 23 00:14:16 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:17 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 1073741824" returned: 0 in 1.430s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:17 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 Sep 23 00:14:17 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:18 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4" returned: 0 in 0.609s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0670d6d4-aa15-47a4-8545-8629826f5432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37783086-3295-4faf-9e56-ab0358d6098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:18 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Volume volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 (833edb6f-57e8-4b5d-81ab-8a4328e1efa4): created successfully Sep 23 00:14:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37783086-3295-4faf-9e56-ab0358d6098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Flow 'volume_create_manager' (f8e6c3da-6be2-47fa-b892-9433ec36b618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:18 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-11e9f319-87f1-4353-9f71-5cc2f9db382c tempest-ServerRescueNegativeTestJSON-12175966 None] Created volume successfully. Sep 23 00:14:23 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Flow 'volume_create_manager' (448bb2d4-bcfa-441c-a4e1-6062b120aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f417519-d419-480e-a01a-c8c1219d687b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f417519-d419-480e-a01a-c8c1219d687b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-179986042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d923a01b-c105-4a75-84e3-ce709f9979d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f25c4a2bf04b66b267ef5508a6d668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:24Z,use_quota=True,user_id='21d82af02ece4cb28f432e479385d12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b70f63c-ae01-4bf5-9c4b-d41748a167d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b70f63c-ae01-4bf5-9c4b-d41748a167d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ac4edb-610f-4caf-9171-56e9c33f4dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ac4edb-610f-4caf-9171-56e9c33f4dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd923a01b-c105-4a75-84e3-ce709f9979d2', 'volume_name': 'volume-d923a01b-c105-4a75-84e3-ce709f9979d2', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d8450d-68ed-4317-ab1c-ca42002987f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d8450d-68ed-4317-ab1c-ca42002987f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ff6e48-2208-4a7b-8ef1-3162d16f34cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Volume d923a01b-c105-4a75-84e3-ce709f9979d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d923a01b-c105-4a75-84e3-ce709f9979d2', 'volume_size': 1} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-179986042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d923a01b-c105-4a75-84e3-ce709f9979d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f25c4a2bf04b66b267ef5508a6d668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:24Z,use_quota=True,user_id='21d82af02ece4cb28f432e479385d12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Creating volume d923a01b-c105-4a75-84e3-ce709f9979d2 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:24 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:14:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:24 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2 1073741824 Sep 23 00:14:24 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:25 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2 1073741824" returned: 0 in 0.995s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:25 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2 Sep 23 00:14:25 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:25 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2" returned: 0 in 0.576s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ff6e48-2208-4a7b-8ef1-3162d16f34cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d923a01b-c105-4a75-84e3-ce709f9979d2', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fe3951-b9ef-4c3c-bb7f-fe26511f9c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Volume volume-d923a01b-c105-4a75-84e3-ce709f9979d2 (d923a01b-c105-4a75-84e3-ce709f9979d2): created successfully Sep 23 00:14:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75fe3951-b9ef-4c3c-bb7f-fe26511f9c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Flow 'volume_create_manager' (448bb2d4-bcfa-441c-a4e1-6062b120aee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-831593c4-3dae-4b3e-9b31-a88f3fcaefa5 tempest-ServerActionsTestOtherA-2073692176 None] Created volume successfully. Sep 23 00:14:36 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:36 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Flow 'volume_create_manager' (39302fa7-7091-4340-bcb7-4ed5ee96fae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad2a5d6-7076-46d4-a9af-2c3423ad9637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad2a5d6-7076-46d4-a9af-2c3423ad9637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-569145388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b70fa7-0524-4d78-9216-badc43f33057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dceef42ed15421192abd170eeb537c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:40Z,use_quota=True,user_id='fedb38f00cf94570afbceb4c02d3b27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f589ba-c753-42cc-bf93-65b6b56e509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1f589ba-c753-42cc-bf93-65b6b56e509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9626aeae-be38-4e1f-9916-fdf7cd1cdd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9626aeae-be38-4e1f-9916-fdf7cd1cdd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b70fa7-0524-4d78-9216-badc43f33057', 'volume_name': 'volume-11b70fa7-0524-4d78-9216-badc43f33057', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440c92c1-0737-4b98-bf67-086820a079b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440c92c1-0737-4b98-bf67-086820a079b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12170e8c-92e0-443e-94d1-018fa305690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:40 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Volume 11b70fa7-0524-4d78-9216-badc43f33057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b70fa7-0524-4d78-9216-badc43f33057', 'volume_size': 1} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-569145388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b70fa7-0524-4d78-9216-badc43f33057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dceef42ed15421192abd170eeb537c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:40Z,use_quota=True,user_id='fedb38f00cf94570afbceb4c02d3b27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Creating volume 11b70fa7-0524-4d78-9216-badc43f33057 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:40 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:14:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:40 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057 1073741824 Sep 23 00:14:40 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:41 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057 1073741824" returned: 0 in 0.854s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:41 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057 Sep 23 00:14:41 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:41 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057" returned: 0 in 0.461s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12170e8c-92e0-443e-94d1-018fa305690b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b70fa7-0524-4d78-9216-badc43f33057', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fbd1b7-9dea-494e-be39-b53c587deafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Volume volume-11b70fa7-0524-4d78-9216-badc43f33057 (11b70fa7-0524-4d78-9216-badc43f33057): created successfully Sep 23 00:14:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51fbd1b7-9dea-494e-be39-b53c587deafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Flow 'volume_create_manager' (39302fa7-7091-4340-bcb7-4ed5ee96fae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:42 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b3d58d85-a93b-4d69-8af6-3ac4b63ea7e9 tempest-TaggedAttachmentsTest-116161863 None] Created volume successfully. Sep 23 00:14:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Acquiring lock "cinder-833edb6f-57e8-4b5d-81ab-8a4328e1efa4-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "cinder-833edb6f-57e8-4b5d-81ab-8a4328e1efa4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Acquiring lock "cinder-quobyte-833edb6f-57e8-4b5d-81ab-8a4328e1efa4" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "cinder-quobyte-833edb6f-57e8-4b5d-81ab-8a4328e1efa4" acquired by "delete_volume" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8a2991-cb6e-4afa-8fe0-588bad33d6f7]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:43 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 Sep 23 00:14:43 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:44 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4" returned: 0 in 1.108s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:44 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4 Sep 23 00:14:44 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Flow 'volume_create_manager' (fd1521a1-194c-48fd-899c-7854060f3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d04f524-5c32-4d97-90c3-7a92dff4b030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d04f524-5c32-4d97-90c3-7a92dff4b030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1394373931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d613e2afa7e74c948cc7d8cc5cc6dcd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:44Z,use_quota=True,user_id='f5b334e15da946428d554829beee0964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49688c18-6d04-486c-a835-db304911ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49688c18-6d04-486c-a835-db304911ee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7608f24f-4881-451d-af8c-a8b66240bca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7608f24f-4881-451d-af8c-a8b66240bca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0', 'volume_name': 'volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b93cbc3-4d79-4ce5-8730-317329d19f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b93cbc3-4d79-4ce5-8730-317329d19f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f4a027-7c02-4e5e-b8c6-86c19ffc39a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:44 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Volume 7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0', 'volume_size': 1} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1394373931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d613e2afa7e74c948cc7d8cc5cc6dcd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:14:44Z,use_quota=True,user_id='f5b334e15da946428d554829beee0964',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Creating volume 7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:14:44 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:44 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 1073741824 Sep 23 00:14:44 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:44 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-833edb6f-57e8-4b5d-81ab-8a4328e1efa4" returned: 0 in 0.617s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "cinder-quobyte-833edb6f-57e8-4b5d-81ab-8a4328e1efa4" released by "delete_volume" :: held 1.919s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:45 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Created reservations ['7a2fa893-f6bd-4e1b-a25f-e40e5ac420dd', '5c86eed0-9e9f-4aa3-a4f3-614ad6e4b3a7', '166b1403-e663-4ed0-8bd1-a6b51eea2c1a', '332a9d48-f78f-4637-8107-6472883a5ced', 'ab17585f-47b6-43ae-81ff-181eab9d6b22'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:14:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:45 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:14:45 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:45 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 1073741824" returned: 0 in 0.972s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:45 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 Sep 23 00:14:45 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:46 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 1.180s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Deleted volume successfully. Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-006a64c8-85a3-46ce-a831-680dc7d6f675 tempest-ServerRescueNegativeTestJSON-12175966 None] Lock "cinder-833edb6f-57e8-4b5d-81ab-8a4328e1efa4-delete_volume" released by "delete_volume" :: held 3.902s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:46 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0" returned: 0 in 1.165s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f4a027-7c02-4e5e-b8c6-86c19ffc39a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c78676-786a-4b0c-80b3-18e761d63a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:14:46 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Volume volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 (7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0): created successfully Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c78676-786a-4b0c-80b3-18e761d63a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:14:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Flow 'volume_create_manager' (fd1521a1-194c-48fd-899c-7854060f3c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:14:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1e6725db-09fe-499a-8437-621d1cd7fee4 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Created volume successfully. Sep 23 00:14:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Acquiring lock "cinder-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "cinder-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Acquiring lock "cinder-quobyte-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:14:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "cinder-quobyte-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:14:50 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a495f52d-d125-490d-8dfd-a61c2cdf0462]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:14:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:50 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 Sep 23 00:14:50 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:51 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0" returned: 0 in 1.298s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:51 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0 Sep 23 00:14:51 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:52 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0" returned: 0 in 0.672s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "cinder-quobyte-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0" released by "delete_volume" :: held 2.087s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:14:52 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Created reservations ['b97f0185-2bf0-4789-9ebb-885b0c980565', '17d269cc-6142-4f8e-9b8d-9b81737c749b', 'a2a4d400-ddec-4aba-a7ec-f6f9b52875d1', '961aad84-3c2b-49c4-9792-a20ffe149d5a', '014435a5-210b-4f1e-b287-58f38af6c790'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:14:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:14:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:14:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:14:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:14:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:14:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:14:53 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:14:53 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:14:54 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Sep 23 00:14:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 1.179s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:14:54 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:14:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Deleted volume successfully. Sep 23 00:14:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7d9e78b-f6d4-456a-9155-74a1e5f38a80 tempest-VolumeQuotasNegativeTestJSON-1786604371 None] Lock "cinder-7b9eb3ef-202d-4c4c-ba4e-65ded527f8d0-delete_volume" released by "delete_volume" :: held 4.051s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:02 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:15:02 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:02 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=15,cinder:UPDATE=23,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:03 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.445s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:15:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 8 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:15:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:15:04 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=17,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:15:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9b61331c-000d-404b-aa34-aa2af7fb85d6 tempest-GroupsTest-911563510 None] Group tempest-Group1-1862539621: creating Sep 23 00:15:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9b61331c-000d-404b-aa34-aa2af7fb85d6 tempest-GroupsTest-911563510 None] Group tempest-Group1-1862539621: created successfully Sep 23 00:15:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9b61331c-000d-404b-aa34-aa2af7fb85d6 tempest-GroupsTest-911563510 None] Create group completed successfully. Sep 23 00:15:21 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-97bce133-99ff-4a48-af94-b298e1953068 tempest-GroupsTest-911563510 None] Group tempest-Group2-1074348395: creating Sep 23 00:15:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-97bce133-99ff-4a48-af94-b298e1953068 tempest-GroupsTest-911563510 None] Group tempest-Group2-1074348395: created successfully Sep 23 00:15:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-97bce133-99ff-4a48-af94-b298e1953068 tempest-GroupsTest-911563510 None] Create group completed successfully. Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Flow 'volume_create_manager' (fed67fc2-f4f2-4050-bc8e-6679fdb8dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4cb163-4dfc-4459-9dee-522c07c6bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4cb163-4dfc-4459-9dee-522c07c6bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36252020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b71063ce-3e7f-400a-87ec-3360c8d8c8b6,host='devstack@QuobyteHD#QuobyteHD',id=2c0713cc-386d-4a04-a85c-350deb5239b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a45efa5ee4bd09403092b3bca2e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:24Z,use_quota=True,user_id='cebc85ac600543a78b04d66024482fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b31e9949-b081-44e0-b292-9bd7d1e2d306),volume_type_id=b31e9949-b081-44e0-b292-9bd7d1e2d306)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941a21f4-fa13-4f68-a7c7-7e871d4fd5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941a21f4-fa13-4f68-a7c7-7e871d4fd5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d87cc1-f885-4a8c-a326-5145d0eb5643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d87cc1-f885-4a8c-a326-5145d0eb5643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c0713cc-386d-4a04-a85c-350deb5239b8', 'volume_name': 'volume-2c0713cc-386d-4a04-a85c-350deb5239b8', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25743199-a315-405f-9508-0616a5ea6155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25743199-a315-405f-9508-0616a5ea6155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6309dd0e-e42d-4f4f-83bf-34484947817d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Volume 2c0713cc-386d-4a04-a85c-350deb5239b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c0713cc-386d-4a04-a85c-350deb5239b8', 'volume_size': 1} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b71063ce-3e7f-400a-87ec-3360c8d8c8b6,created_at=2026-09-22T22:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-36252020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b71063ce-3e7f-400a-87ec-3360c8d8c8b6,host='devstack@QuobyteHD#QuobyteHD',id=2c0713cc-386d-4a04-a85c-350deb5239b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a45efa5ee4bd09403092b3bca2e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:24Z,use_quota=True,user_id='cebc85ac600543a78b04d66024482fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b31e9949-b081-44e0-b292-9bd7d1e2d306),volume_type_id=b31e9949-b081-44e0-b292-9bd7d1e2d306)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Creating volume 2c0713cc-386d-4a04-a85c-350deb5239b8 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:24 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:24 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8 1073741824 Sep 23 00:15:24 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Flow 'volume_create_manager' (3e1041ea-7c0f-4b90-b679-2bbd40012faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc2cd4a-71db-4645-bfb3-0124680d608d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-a61d95bb-ff9d-4ccd-aec6-8c5f9f177727 req-2de2d29f-beab-4c90-81ef-222f98f2579e tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc2cd4a-71db-4645-bfb3-0124680d608d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1744942690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcf858e-b986-4f98-aee7-233f652493a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4432bce7a3314e0097346069a48cf547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:25Z,use_quota=True,user_id='c23d2fc1695141959a6609e4b3892b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f450fb-6c03-4b9a-bcf2-1c32fdfd7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f450fb-6c03-4b9a-bcf2-1c32fdfd7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bd8b1-8369-4526-9687-a9c7a17a1cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (967bd8b1-8369-4526-9687-a9c7a17a1cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efcf858e-b986-4f98-aee7-233f652493a8', 'volume_name': 'volume-efcf858e-b986-4f98-aee7-233f652493a8', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba44004-59d1-4dd4-9a06-0856cae162ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba44004-59d1-4dd4-9a06-0856cae162ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862bdb2e-f2b6-4d1b-adec-8ce716bb76ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Volume efcf858e-b986-4f98-aee7-233f652493a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efcf858e-b986-4f98-aee7-233f652493a8', 'volume_size': 1} Sep 23 00:15:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:25 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8 1073741824" returned: 0 in 0.567s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:25 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8 Sep 23 00:15:25 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:25 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8" returned: 0 in 0.332s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-a61d95bb-ff9d-4ccd-aec6-8c5f9f177727 req-2de2d29f-beab-4c90-81ef-222f98f2579e tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.866s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6309dd0e-e42d-4f4f-83bf-34484947817d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c0713cc-386d-4a04-a85c-350deb5239b8', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5c4f9a-4cfd-43f5-b7c9-9121c50b6f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-a61d95bb-ff9d-4ccd-aec6-8c5f9f177727 req-2de2d29f-beab-4c90-81ef-222f98f2579e tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.858s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1744942690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcf858e-b986-4f98-aee7-233f652493a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4432bce7a3314e0097346069a48cf547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:25Z,use_quota=True,user_id='c23d2fc1695141959a6609e4b3892b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Creating volume efcf858e-b986-4f98-aee7-233f652493a8 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:25 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Volume volume-2c0713cc-386d-4a04-a85c-350deb5239b8 (2c0713cc-386d-4a04-a85c-350deb5239b8): created successfully Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5c4f9a-4cfd-43f5-b7c9-9121c50b6f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:25 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8 1073741824 Sep 23 00:15:25 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Flow 'volume_create_manager' (fed67fc2-f4f2-4050-bc8e-6679fdb8dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-44d39c6c-6282-403c-9715-cea110ff50c1 tempest-GroupsTest-911563510 None] Created volume successfully. Sep 23 00:15:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-a61d95bb-ff9d-4ccd-aec6-8c5f9f177727 req-2de2d29f-beab-4c90-81ef-222f98f2579e tempest-ServerActionsTestOtherA-2073692176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-d923a01b-c105-4a75-84e3-ce709f9979d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35277e28-3aa9-4e21-911b-83617c0a3034', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-a61d95bb-ff9d-4ccd-aec6-8c5f9f177727 req-2de2d29f-beab-4c90-81ef-222f98f2579e tempest-ServerActionsTestOtherA-2073692176 None] attachment_update completed successfully. Sep 23 00:15:26 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8 1073741824" returned: 0 in 0.689s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:26 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8 Sep 23 00:15:26 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:26 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8" returned: 0 in 0.399s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (862bdb2e-f2b6-4d1b-adec-8ce716bb76ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efcf858e-b986-4f98-aee7-233f652493a8', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8feccb-6327-416c-8bff-8e01d4df4d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:27 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Volume volume-efcf858e-b986-4f98-aee7-233f652493a8 (efcf858e-b986-4f98-aee7-233f652493a8): created successfully Sep 23 00:15:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8feccb-6327-416c-8bff-8e01d4df4d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Flow 'volume_create_manager' (3e1041ea-7c0f-4b90-b679-2bbd40012faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:27 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6a52ac98-88c5-4a58-adb5-bfb1211838b6 tempest-VolumesListAdminTestJSON-912207090 None] Created volume successfully. Sep 23 00:15:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Acquiring lock "cinder-quobyte-2c0713cc-386d-4a04-a85c-350deb5239b8" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Lock "cinder-quobyte-2c0713cc-386d-4a04-a85c-350deb5239b8" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b223a-03f2-40f8-ab0d-b50b7ecae097]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:28 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8 Sep 23 00:15:28 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:28 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8" returned: 0 in 0.581s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:28 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8 Sep 23 00:15:28 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Flow 'volume_create_manager' (acbaad53-b2c7-45ed-b496-11948f53fe4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e431140-e13c-467a-afe3-e7aa8a98a7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e431140-e13c-467a-afe3-e7aa8a98a7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-791896028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7001a365-f857-46a8-bacc-3b3ac4562200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4432bce7a3314e0097346069a48cf547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:29Z,use_quota=True,user_id='c23d2fc1695141959a6609e4b3892b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c159abe-79a9-4218-9880-7daf2731cf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c159abe-79a9-4218-9880-7daf2731cf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e564e2-7795-40bf-9c62-9abfa0ead23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e564e2-7795-40bf-9c62-9abfa0ead23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7001a365-f857-46a8-bacc-3b3ac4562200', 'volume_name': 'volume-7001a365-f857-46a8-bacc-3b3ac4562200', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d6dcc-19e2-4c5a-8b13-88398bfff505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d6dcc-19e2-4c5a-8b13-88398bfff505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61286875-e553-46a3-883f-26a2b5bf1e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Volume 7001a365-f857-46a8-bacc-3b3ac4562200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7001a365-f857-46a8-bacc-3b3ac4562200', 'volume_size': 1} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-791896028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7001a365-f857-46a8-bacc-3b3ac4562200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4432bce7a3314e0097346069a48cf547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:29Z,use_quota=True,user_id='c23d2fc1695141959a6609e4b3892b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Creating volume 7001a365-f857-46a8-bacc-3b3ac4562200 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:28 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:28 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2c0713cc-386d-4a04-a85c-350deb5239b8" returned: 0 in 0.320s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:28 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200 1073741824 Sep 23 00:15:28 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Lock "cinder-quobyte-2c0713cc-386d-4a04-a85c-350deb5239b8" released by "delete_volume" :: held 0.970s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Created reservations ['25931d71-9f2c-4301-be3e-f24217fecdbc'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:29 devstack cinder-volume[87138]: WARNING cinder.quota [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-889226201 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-889226201, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:29 devstack cinder-volume[87138]: WARNING cinder.quota [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-889226201 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-889226201, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Created reservations ['b1a050f2-1642-490c-bce1-bd9e192e7f31', 'd32a0407-2e58-41d3-be56-df2a0c086c42', '085a305a-e1d2-4684-a66a-e7c4e741709f', 'c456b76a-ab6d-443b-967d-3b2c2704dbe3', 'b5bb985f-ba82-43f8-a036-2ea17699dcd4'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:29 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200 1073741824" returned: 0 in 0.754s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:29 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:15:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:29 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:29 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200 Sep 23 00:15:29 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:30 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.389s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:30 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-369ffe53-c1d6-4eda-a85c-5460833b13fb tempest-GroupsTest-911563510 None] Delete group completed successfully. Sep 23 00:15:30 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200" returned: 0 in 0.395s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61286875-e553-46a3-883f-26a2b5bf1e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7001a365-f857-46a8-bacc-3b3ac4562200', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a118a89-315a-4b0a-8070-f9ad6983b698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:30 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Volume volume-7001a365-f857-46a8-bacc-3b3ac4562200 (7001a365-f857-46a8-bacc-3b3ac4562200): created successfully Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a118a89-315a-4b0a-8070-f9ad6983b698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Flow 'volume_create_manager' (acbaad53-b2c7-45ed-b496-11948f53fe4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:30 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e0e4fdee-72f2-49e5-8548-bc4f2bbc2dfd tempest-VolumesListAdminTestJSON-912207090 None] Created volume successfully. Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] Created reservations ['f56b10d8-3ea3-407d-afc6-c9664ebd2302'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:31 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:15:31 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:31 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.559s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:31 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-7606581d-d36f-4dd0-95b4-f8410eed5473 tempest-GroupsTest-911563510 None] Delete group completed successfully. Sep 23 00:15:31 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-4168b0fa-6943-4c65-b717-ee462cce077d req-959170fd-de81-4807-b802-387ab0705648 tempest-ServerActionsTestOtherA-2073692176 None] Terminate volume connection completed successfully. Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-4168b0fa-6943-4c65-b717-ee462cce077d req-959170fd-de81-4807-b802-387ab0705648 tempest-ServerActionsTestOtherA-2073692176 None] Deleting attachment 35277e28-3aa9-4e21-911b-83617c0a3034. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Flow 'volume_create_manager' (ed7a585f-583a-45b9-984b-fd8c9acec765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87d4e37-a45e-4736-b290-f7157de9872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87d4e37-a45e-4736-b290-f7157de9872a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-783962735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6422b21e-5c3c-4602-bb2c-a641ebf588fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4432bce7a3314e0097346069a48cf547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:32Z,use_quota=True,user_id='c23d2fc1695141959a6609e4b3892b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929fec8d-4abf-4a33-a297-2507365eb5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929fec8d-4abf-4a33-a297-2507365eb5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420658af-1515-4519-97c1-92fe95214d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420658af-1515-4519-97c1-92fe95214d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6422b21e-5c3c-4602-bb2c-a641ebf588fa', 'volume_name': 'volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602823bd-9ec4-465b-bb05-f4e9ba857b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (602823bd-9ec4-465b-bb05-f4e9ba857b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b01e9ef-9f96-44ee-9839-af7d07d360bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:32 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Volume 6422b21e-5c3c-4602-bb2c-a641ebf588fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa', 'volume_size': 1} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-783962735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6422b21e-5c3c-4602-bb2c-a641ebf588fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4432bce7a3314e0097346069a48cf547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:32Z,use_quota=True,user_id='c23d2fc1695141959a6609e4b3892b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Creating volume 6422b21e-5c3c-4602-bb2c-a641ebf588fa {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:32 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:32 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa 1073741824 Sep 23 00:15:32 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-4168b0fa-6943-4c65-b717-ee462cce077d req-04ac8e31-f68e-4a3f-b039-0219ccff762c tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:32 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa 1073741824" returned: 0 in 0.894s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:33 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa Sep 23 00:15:33 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3b18a8c0-2a03-4a92-91cd-9ff5da291070 tempest-GroupsTest-911563510 None] Group tempest-GroupsTest-Group-1549686590: creating Sep 23 00:15:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3b18a8c0-2a03-4a92-91cd-9ff5da291070 tempest-GroupsTest-911563510 None] Group tempest-GroupsTest-Group-1549686590: created successfully Sep 23 00:15:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3b18a8c0-2a03-4a92-91cd-9ff5da291070 tempest-GroupsTest-911563510 None] Create group completed successfully. Sep 23 00:15:33 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa" returned: 0 in 0.380s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-4168b0fa-6943-4c65-b717-ee462cce077d req-04ac8e31-f68e-4a3f-b039-0219ccff762c tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.559s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b01e9ef-9f96-44ee-9839-af7d07d360bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c7e29f-f8a6-4d30-950d-9ea36c8496ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-4168b0fa-6943-4c65-b717-ee462cce077d req-04ac8e31-f68e-4a3f-b039-0219ccff762c tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:33 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Volume volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa (6422b21e-5c3c-4602-bb2c-a641ebf588fa): created successfully Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c7e29f-f8a6-4d30-950d-9ea36c8496ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Flow 'volume_create_manager' (ed7a585f-583a-45b9-984b-fd8c9acec765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-07c93f95-74c9-463a-8cb3-3baccd2ca59a tempest-VolumesListAdminTestJSON-912207090 None] Created volume successfully. Sep 23 00:15:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-4168b0fa-6943-4c65-b717-ee462cce077d req-04ac8e31-f68e-4a3f-b039-0219ccff762c tempest-ServerActionsTestOtherA-2073692176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-d923a01b-c105-4a75-84e3-ce709f9979d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98f5c451-9a17-4035-b346-9bd5d67a697b', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-4168b0fa-6943-4c65-b717-ee462cce077d req-04ac8e31-f68e-4a3f-b039-0219ccff762c tempest-ServerActionsTestOtherA-2073692176 None] attachment_update completed successfully. Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Flow 'volume_create_manager' (b1cb1ee7-5245-4f06-9884-a8cbeef68e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a86455-f869-40d2-be26-291eedd96942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a86455-f869-40d2-be26-291eedd96942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54489f4-b5e2-44a5-8493-8701eb5a91ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeccbe050544625b5a67e2f5077b160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:35Z,use_quota=True,user_id='de67aae83b8d4e8ea93a14e0d1fff62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6c50df-d9c6-4ac2-a94b-c047ee19c5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6c50df-d9c6-4ac2-a94b-c047ee19c5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b4fcb-f1f5-4d99-b8f6-9aaa9feb8606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b4fcb-f1f5-4d99-b8f6-9aaa9feb8606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f54489f4-b5e2-44a5-8493-8701eb5a91ce', 'volume_name': 'volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87126972-ce7c-4432-8efb-ef82ad88a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87126972-ce7c-4432-8efb-ef82ad88a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d699fa-fbfe-42c4-af0f-dad059bbb737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Volume f54489f4-b5e2-44a5-8493-8701eb5a91ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce', 'volume_size': 1} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f54489f4-b5e2-44a5-8493-8701eb5a91ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aeccbe050544625b5a67e2f5077b160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:35Z,use_quota=True,user_id='de67aae83b8d4e8ea93a14e0d1fff62c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Creating volume f54489f4-b5e2-44a5-8493-8701eb5a91ce {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:35 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:15:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:35 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce 1073741824 Sep 23 00:15:35 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:36 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Flow 'volume_create_manager' (0b40551e-628c-4156-be24-ffdc4c613b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98471900-3046-4901-859f-570b9701c213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:37 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98471900-3046-4901-859f-570b9701c213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1863541504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c80ff6bb-2982-47b6-b320-f5add0d8ab4d,host='devstack@QuobyteHD#QuobyteHD',id=5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a45efa5ee4bd09403092b3bca2e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:37Z,use_quota=True,user_id='cebc85ac600543a78b04d66024482fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88c411ed-91ff-48ff-ba0e-95f60db39bbc),volume_type_id=88c411ed-91ff-48ff-ba0e-95f60db39bbc)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fb27c2-3b33-4481-9850-19c9c6fa71d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12fb27c2-3b33-4481-9850-19c9c6fa71d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3680331a-a663-4704-b806-990581d059fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3680331a-a663-4704-b806-990581d059fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db', 'volume_name': 'volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab232cf-c497-444a-acaf-5b763a1d87e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab232cf-c497-444a-acaf-5b763a1d87e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625abf4d-2f8e-4740-a0d0-1484edfb7fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:37 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Volume 5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db', 'volume_size': 1} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce 1073741824" returned: 0 in 1.487s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:37 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce Sep 23 00:15:37 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:37 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce" returned: 0 in 0.425s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.494s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c80ff6bb-2982-47b6-b320-f5add0d8ab4d,created_at=2026-09-22T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1863541504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c80ff6bb-2982-47b6-b320-f5add0d8ab4d,host='devstack@QuobyteHD#QuobyteHD',id=5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a45efa5ee4bd09403092b3bca2e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:37Z,use_quota=True,user_id='cebc85ac600543a78b04d66024482fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88c411ed-91ff-48ff-ba0e-95f60db39bbc),volume_type_id=88c411ed-91ff-48ff-ba0e-95f60db39bbc)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Creating volume 5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:37 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d699fa-fbfe-42c4-af0f-dad059bbb737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0304bff-1b28-4eea-8492-5b478d074462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:37 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db 1073741824 Sep 23 00:15:37 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:37 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Volume volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce (f54489f4-b5e2-44a5-8493-8701eb5a91ce): created successfully Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0304bff-1b28-4eea-8492-5b478d074462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Flow 'volume_create_manager' (b1cb1ee7-5245-4f06-9884-a8cbeef68e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:37 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3698a9d9-40db-4566-b06d-f936906a0f4a tempest-VolumesListAdminTestJSON-41276863 None] Created volume successfully. Sep 23 00:15:38 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db 1073741824" returned: 0 in 0.934s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:38 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db Sep 23 00:15:38 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:39 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db" returned: 0 in 0.467s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Acquiring lock "cinder-f54489f4-b5e2-44a5-8493-8701eb5a91ce-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625abf4d-2f8e-4740-a0d0-1484edfb7fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e68acf-76a4-4265-9fb4-9854d3319884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Lock "cinder-f54489f4-b5e2-44a5-8493-8701eb5a91ce-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:39 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Volume volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db (5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db): created successfully Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e68acf-76a4-4265-9fb4-9854d3319884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Flow 'volume_create_manager' (0b40551e-628c-4156-be24-ffdc4c613b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:39 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-59bfc306-e1be-4ce7-a9a9-cb67d7a1bcc9 tempest-GroupsTest-911563510 None] Created volume successfully. Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Acquiring lock "cinder-quobyte-f54489f4-b5e2-44a5-8493-8701eb5a91ce" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Lock "cinder-quobyte-f54489f4-b5e2-44a5-8493-8701eb5a91ce" acquired by "delete_volume" :: waited 0.042s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccc7753-f97b-4bd1-8fda-053597551ae8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "cinder-6422b21e-5c3c-4602-bb2c-a641ebf588fa-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-6422b21e-5c3c-4602-bb2c-a641ebf588fa-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "cinder-quobyte-6422b21e-5c3c-4602-bb2c-a641ebf588fa" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-quobyte-6422b21e-5c3c-4602-bb2c-a641ebf588fa" acquired by "delete_volume" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae56fcd0-bcc9-4aa7-be08-b5f2af8c5e0c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:39 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce Sep 23 00:15:39 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:40 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa Sep 23 00:15:40 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:40 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce" returned: 0 in 1.146s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:40 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce Sep 23 00:15:40 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:41 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa" returned: 0 in 1.169s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:41 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa Sep 23 00:15:41 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:41 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f54489f4-b5e2-44a5-8493-8701eb5a91ce" returned: 0 in 0.618s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Lock "cinder-quobyte-f54489f4-b5e2-44a5-8493-8701eb5a91ce" released by "delete_volume" :: held 1.960s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Flow 'volume_create_manager' (872d0a9a-2603-4bd4-a384-6c5c387af59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d3056e-02b9-416b-85d2-58bc03639b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d3056e-02b9-416b-85d2-58bc03639b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1560021560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c80ff6bb-2982-47b6-b320-f5add0d8ab4d,host='devstack@QuobyteHD#QuobyteHD',id=d19f6d1c-94df-4ca2-9998-9312b7ff58c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a45efa5ee4bd09403092b3bca2e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:41Z,use_quota=True,user_id='cebc85ac600543a78b04d66024482fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88c411ed-91ff-48ff-ba0e-95f60db39bbc),volume_type_id=88c411ed-91ff-48ff-ba0e-95f60db39bbc)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2809e7f5-7cce-49dc-8213-d4a2a7903d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2809e7f5-7cce-49dc-8213-d4a2a7903d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8758f9c1-92e8-44ad-9bcd-837552289ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8758f9c1-92e8-44ad-9bcd-837552289ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19f6d1c-94df-4ca2-9998-9312b7ff58c6', 'volume_name': 'volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7673fd8-dde4-4360-8ce2-146fb2ca9f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7673fd8-dde4-4360-8ce2-146fb2ca9f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85d03b7-5270-4cf1-962d-0bc7f7d0b4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Volume d19f6d1c-94df-4ca2-9998-9312b7ff58c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6', 'volume_size': 1} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c80ff6bb-2982-47b6-b320-f5add0d8ab4d,created_at=2026-09-22T22:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1560021560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c80ff6bb-2982-47b6-b320-f5add0d8ab4d,host='devstack@QuobyteHD#QuobyteHD',id=d19f6d1c-94df-4ca2-9998-9312b7ff58c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513a45efa5ee4bd09403092b3bca2e76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:41Z,use_quota=True,user_id='cebc85ac600543a78b04d66024482fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88c411ed-91ff-48ff-ba0e-95f60db39bbc),volume_type_id=88c411ed-91ff-48ff-ba0e-95f60db39bbc)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Creating volume d19f6d1c-94df-4ca2-9998-9312b7ff58c6 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:41 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:41 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6422b21e-5c3c-4602-bb2c-a641ebf588fa" returned: 0 in 0.666s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:41 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 1073741824 Sep 23 00:15:41 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-quobyte-6422b21e-5c3c-4602-bb2c-a641ebf588fa" released by "delete_volume" :: held 1.976s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Created reservations ['c21e0124-775a-4278-abb2-074cfd465b45', 'd7439f0c-f312-4ba7-8dc8-48ee73028c62', '0639996b-ccbf-44cf-900a-952a16787f6f', '1199fd41-9901-46f4-8545-f1a98794a98a', '38b996b0-7e57-4ba6-b93d-c178cb4d5910'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:41 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Created reservations ['8b7b84f2-443e-4bd5-8c84-a38d7484cce4', 'c8015ab6-12a2-44e5-bbc1-3c7759361fc1', '06283a94-9baa-4d7a-9527-233b98c022c6', '5f98f2d3-844b-45e4-b758-00ecd2b0c72e', '21eb9f50-5938-4b31-9c34-94aa95253b16'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:42 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:15:42 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:42 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:15:42 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "cinder-7001a365-f857-46a8-bacc-3b3ac4562200-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-7001a365-f857-46a8-bacc-3b3ac4562200-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "cinder-quobyte-7001a365-f857-46a8-bacc-3b3ac4562200" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-quobyte-7001a365-f857-46a8-bacc-3b3ac4562200" acquired by "delete_volume" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:42 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.634s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:42 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 1073741824" returned: 0 in 1.004s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:42 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Deleted volume successfully. Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c81e2b-f7d1-4a2f-a481-4f71d79120e3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c3aeda7c-a735-4223-86e0-a9c749e1f11e tempest-VolumesListAdminTestJSON-41276863 None] Lock "cinder-f54489f4-b5e2-44a5-8493-8701eb5a91ce-delete_volume" released by "delete_volume" :: held 3.516s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:42 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.625s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:42 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 Sep 23 00:15:42 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:42 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Deleted volume successfully. Sep 23 00:15:42 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200 Sep 23 00:15:42 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dbf3f8d2-f0e5-494a-be94-1b3c82b2736f tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-6422b21e-5c3c-4602-bb2c-a641ebf588fa-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:43 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200" returned: 0 in 0.613s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:43 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6" returned: 0 in 0.548s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85d03b7-5270-4cf1-962d-0bc7f7d0b4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:43 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200 Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73704cf7-c9c2-4c50-a92a-02755ff53e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:43 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:43 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Volume volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 (d19f6d1c-94df-4ca2-9998-9312b7ff58c6): created successfully Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73704cf7-c9c2-4c50-a92a-02755ff53e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Flow 'volume_create_manager' (872d0a9a-2603-4bd4-a384-6c5c387af59b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:43 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-35279a4f-06b2-4ccb-b575-53d420efe016 tempest-GroupsTest-911563510 None] Created volume successfully. Sep 23 00:15:43 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7001a365-f857-46a8-bacc-3b3ac4562200" returned: 0 in 0.350s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-quobyte-7001a365-f857-46a8-bacc-3b3ac4562200" released by "delete_volume" :: held 1.071s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Created reservations ['eddd85e0-c5f5-4f5f-a76f-6602ac726979', '101ebc31-167b-4b24-9c63-872572f896fb', 'a12f3f0e-c3e5-4d4d-a7e8-66056c9378ca', '78bcaa0a-f629-43c8-bb49-1b6e68a07b99', '9f23ca27-8714-4d22-b93b-ef007a09745a'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:43 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:15:43 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:44 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.421s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:44 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:44 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Deleted volume successfully. Sep 23 00:15:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fc37ab3-9ae8-4aa3-a9d3-f840cfec2fee tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-7001a365-f857-46a8-bacc-3b3ac4562200-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:44 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bc7ecad0-0975-4790-86c5-e6885c74d44c tempest-GroupsTest-911563510 None] Update group completed successfully. Sep 23 00:15:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "cinder-efcf858e-b986-4f98-aee7-233f652493a8-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-efcf858e-b986-4f98-aee7-233f652493a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "cinder-quobyte-efcf858e-b986-4f98-aee7-233f652493a8" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-quobyte-efcf858e-b986-4f98-aee7-233f652493a8" acquired by "delete_volume" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:45 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5448021-2439-4d5a-ab69-c6d956c723d4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:45 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8 Sep 23 00:15:45 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:46 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8" returned: 0 in 0.901s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:46 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8 Sep 23 00:15:46 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:46 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-efcf858e-b986-4f98-aee7-233f652493a8" returned: 0 in 0.726s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-quobyte-efcf858e-b986-4f98-aee7-233f652493a8" released by "delete_volume" :: held 1.718s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:47 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Created reservations ['40faf565-b1ce-4104-9741-89dcac1db30a', '37ba4313-f80e-49dd-a0e9-499523e68806', '23ec2fe6-a030-48c2-b5b6-d0ff65f93d33', '8b51900c-7dd6-474b-a490-c2905a1468fe', '8c84d183-b180-4cef-8d3e-85219020f032'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-671afd17-7161-4528-b277-64bf345e7771 tempest-GroupsTest-911563510 None] Update group completed successfully. Sep 23 00:15:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:47 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:15:47 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:48 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.606s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:48 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:48 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Deleted volume successfully. Sep 23 00:15:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bad8f25c-b2fb-4f6f-bb5b-1a33817d022a tempest-VolumesListAdminTestJSON-912207090 None] Lock "cinder-efcf858e-b986-4f98-aee7-233f652493a8-delete_volume" released by "delete_volume" :: held 3.109s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-49a5e18c-5c7a-4f14-ae8a-54b97fe67a00 req-a04e5c92-0fe8-4871-89e3-2bff240ffa32 tempest-TaggedAttachmentsTest-116161863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-49a5e18c-5c7a-4f14-ae8a-54b97fe67a00 req-a04e5c92-0fe8-4871-89e3-2bff240ffa32 tempest-TaggedAttachmentsTest-116161863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-49a5e18c-5c7a-4f14-ae8a-54b97fe67a00 req-a04e5c92-0fe8-4871-89e3-2bff240ffa32 tempest-TaggedAttachmentsTest-116161863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-49a5e18c-5c7a-4f14-ae8a-54b97fe67a00 req-a04e5c92-0fe8-4871-89e3-2bff240ffa32 tempest-TaggedAttachmentsTest-116161863 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-11b70fa7-0524-4d78-9216-badc43f33057', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fed97af5-5852-4241-a8e8-01658b422c53', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:15:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Acquiring lock "cinder-quobyte-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Lock "cinder-quobyte-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db" acquired by "delete_volume" :: waited 0.055s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-49a5e18c-5c7a-4f14-ae8a-54b97fe67a00 req-a04e5c92-0fe8-4871-89e3-2bff240ffa32 tempest-TaggedAttachmentsTest-116161863 None] attachment_update completed successfully. Sep 23 00:15:49 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8422b3c1-c9a7-4734-a862-ac0ab21ddbc2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:50 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db Sep 23 00:15:50 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:50 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db" returned: 0 in 0.697s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:50 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db Sep 23 00:15:50 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:50 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db" returned: 0 in 0.357s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Lock "cinder-quobyte-5bbbe98a-8782-4b70-aa7c-9f2f9e5b60db" released by "delete_volume" :: held 1.128s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Acquiring lock "cinder-quobyte-d19f6d1c-94df-4ca2-9998-9312b7ff58c6" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:15:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Lock "cinder-quobyte-d19f6d1c-94df-4ca2-9998-9312b7ff58c6" acquired by "delete_volume" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:15:51 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e47e04-0836-48d7-bf91-dd43e040ca8c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:51 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 Sep 23 00:15:51 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:51 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6" returned: 0 in 0.647s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:51 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6 Sep 23 00:15:51 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:51 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d19f6d1c-94df-4ca2-9998-9312b7ff58c6" returned: 0 in 0.320s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Lock "cinder-quobyte-d19f6d1c-94df-4ca2-9998-9312b7ff58c6" released by "delete_volume" :: held 1.033s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Created reservations ['72b9b88c-e92b-4b4f-8820-caa6ecfe1796'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:52 devstack cinder-volume[87138]: WARNING cinder.quota [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-11251833 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-11251833, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:52 devstack cinder-volume[87138]: WARNING cinder.quota [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-11251833 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-11251833, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Created reservations ['42da8c27-ff7c-48f3-b3b0-21e020ae2c89', '15d4af8e-6b1a-4a71-9982-a5465c446a14', '63236ace-062f-4438-b0e6-c285d72da61b', 'c6c73ebc-7e0c-48b3-acd5-e5799ce3d4d0', 'c220947d-b55f-4f67-9373-26aba56de5f8'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Created reservations ['eaf151ba-e4f0-4305-b8b8-723471f98f03', '86392d22-1044-4ab9-b563-805a745e9746', '919946ba-a1df-4ff6-86a8-165141cc743f', '5a4273de-de13-48f0-b7c3-066efc36d587', 'b847393f-9f3b-4b20-b268-35772a9e557c'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:52 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:15:52 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:53 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.509s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:53 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:15:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fbdf74c8-820c-4f86-bc97-ce03525e1744 tempest-GroupsTest-911563510 None] Delete group completed successfully. Sep 23 00:15:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-500cc175-3e75-430b-9f74-9dc5871cdacc req-e5692727-7c2d-417f-8e3f-c97c955232c8 tempest-TaggedAttachmentsTest-116161863 None] Terminate volume connection completed successfully. Sep 23 00:15:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-500cc175-3e75-430b-9f74-9dc5871cdacc req-e5692727-7c2d-417f-8e3f-c97c955232c8 tempest-TaggedAttachmentsTest-116161863 None] Deleting attachment fed97af5-5852-4241-a8e8-01658b422c53. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Flow 'volume_create_manager' (dbfef7b6-4369-4f94-a6d5-48c44125c92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403127f6-1698-497e-a8f7-d216e1965b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (403127f6-1698-497e-a8f7-d216e1965b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431161135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e93be1-36eb-4c52-b5cf-e704a42d3acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43aac18f28474b38af4e6e8cce0b1830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:57Z,use_quota=True,user_id='d294fad719744d68a4a0d20644d1dddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f468086a-caf4-484a-a541-03a1d7d10cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f468086a-caf4-484a-a541-03a1d7d10cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ca6ead-6c1b-435c-89d9-0cf7071d4550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ca6ead-6c1b-435c-89d9-0cf7071d4550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e93be1-36eb-4c52-b5cf-e704a42d3acd', 'volume_name': 'volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a57a0d-8b00-4def-9145-e7cb7edf32c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a57a0d-8b00-4def-9145-e7cb7edf32c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e00259-4418-4fc5-a31e-7ca584d28d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:57 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Volume 36e93be1-36eb-4c52-b5cf-e704a42d3acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd', 'volume_size': 1} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431161135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e93be1-36eb-4c52-b5cf-e704a42d3acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43aac18f28474b38af4e6e8cce0b1830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:15:57Z,use_quota=True,user_id='d294fad719744d68a4a0d20644d1dddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Creating volume 36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:15:57 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:57 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd 1073741824 Sep 23 00:15:57 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:57 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd 1073741824" returned: 0 in 0.554s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:57 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd Sep 23 00:15:57 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:15:58 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Sep 23 00:15:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd" returned: 0 in 0.350s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:15:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:15:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:15:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e00259-4418-4fc5-a31e-7ca584d28d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79efdd01-4e42-499e-ac4f-510e771dd424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:15:58 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Volume volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd (36e93be1-36eb-4c52-b5cf-e704a42d3acd): created successfully Sep 23 00:15:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79efdd01-4e42-499e-ac4f-510e771dd424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:15:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Flow 'volume_create_manager' (dbfef7b6-4369-4f94-a6d5-48c44125c92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:15:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e078f91a-afd6-440a-a63a-418c04b7668c tempest-VolumesDeleteCascade-871597615 None] Created volume successfully. Sep 23 00:15:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:15:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:15:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Creating offline snapshot bd038e97-2b15-4db2-8776-37d489350684 of volume 36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:15:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a7817-a0a3-4b48-960f-eb2cf54d13be]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:15:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:15:59 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd Sep 23 00:15:59 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:00 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd" returned: 0 in 0.631s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:00 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 1G Sep 23 00:16:00 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:01 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 1G" returned: 0 in 0.912s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:01 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 Sep 23 00:16:01 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:02 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684" returned: 0 in 0.674s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:02 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 is being set with open permissions: ugo+rw Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:02 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 Sep 23 00:16:02 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:02 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684" returned: 0 in 0.553s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:02 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.info Sep 23 00:16:02 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:02 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:16:02 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:03 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.info" returned: 0 in 0.599s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:03 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.info is being set with open permissions: ugo+rw Sep 23 00:16:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:03 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.info Sep 23 00:16:03 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:03 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.848s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:16:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 8 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:16:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:16:03 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.info" returned: 0 in 0.631s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.178s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:03 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-430a1841-2acc-4259-bb83-1367b00ace9a tempest-VolumesDeleteCascade-871597615 None] Create snapshot completed successfully Sep 23 00:16:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Creating offline snapshot 76908dfa-24f6-439b-a417-4bccb67bcea6 of volume 36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:04 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee29e4c-e075-404f-ba02-2d017e986a85]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:05 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 Sep 23 00:16:05 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:05 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-0171f34b-c6ea-48bf-be06-c52e3c3c6fd7 req-703ee573-2311-4b77-8978-34b3ef435ad5 tempest-ServerActionsTestOtherA-2073692176 None] Terminate volume connection completed successfully. Sep 23 00:16:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-0171f34b-c6ea-48bf-be06-c52e3c3c6fd7 req-703ee573-2311-4b77-8978-34b3ef435ad5 tempest-ServerActionsTestOtherA-2073692176 None] Deleting attachment 98f5c451-9a17-4035-b346-9bd5d67a697b. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:16:05 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684" returned: 0 in 0.852s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:05 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 1G Sep 23 00:16:05 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:06 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 1G" returned: 0 in 1.309s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:07 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 Sep 23 00:16:07 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:07 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6" returned: 0 in 0.744s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:07 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 is being set with open permissions: ugo+rw Sep 23 00:16:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:07 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 Sep 23 00:16:07 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:08 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6" returned: 0 in 0.453s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.612s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f31634ed-4af9-4b45-a92a-4e00463e22e0 tempest-VolumesDeleteCascade-871597615 None] Create snapshot completed successfully Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-36e93be1-36eb-4c52-b5cf-e704a42d3acd-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-36e93be1-36eb-4c52-b5cf-e704a42d3acd-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Performing cascade delete. {{(pid=87138) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-76908dfa-24f6-439b-a417-4bccb67bcea6-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-76908dfa-24f6-439b-a417-4bccb67bcea6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-36e93be1-36eb-4c52-b5cf-e704a42d3acd" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-36e93be1-36eb-4c52-b5cf-e704a42d3acd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-76908dfa-24f6-439b-a417-4bccb67bcea6" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-76908dfa-24f6-439b-a417-4bccb67bcea6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Deleting offline snapshot 76908dfa-24f6-439b-a417-4bccb67bcea6 of volume 36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] snapshot_file for this snap is: volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a389a4c-5a65-4f76-b1bc-a16bb47c8fa5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:09 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 Sep 23 00:16:09 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:10 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6" returned: 0 in 0.656s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[95acfdb2-c349-47d8-90f6-97b5cc72b112]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:10 devstack sudo[91430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 Sep 23 00:16:10 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Acquiring lock "cinder-11b70fa7-0524-4d78-9216-badc43f33057-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Lock "cinder-11b70fa7-0524-4d78-9216-badc43f33057-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:10 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684" returned: 0 in 0.651s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Acquiring lock "cinder-quobyte-11b70fa7-0524-4d78-9216-badc43f33057" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:10 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 Sep 23 00:16:10 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Lock "cinder-quobyte-11b70fa7-0524-4d78-9216-badc43f33057" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdb4a75-e0c3-4c30-a533-f4790efeb84f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:11 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057 Sep 23 00:16:11 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:11 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6" returned: 0 in 0.782s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:11 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6 Sep 23 00:16:11 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:11 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057" returned: 0 in 0.838s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:11 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057 Sep 23 00:16:11 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:12 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.76908dfa-24f6-439b-a417-4bccb67bcea6" returned: 0 in 0.423s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-76908dfa-24f6-439b-a417-4bccb67bcea6" released by "_delete_snapshot" :: held 2.749s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-36e93be1-36eb-4c52-b5cf-e704a42d3acd" released by "delete_snapshot" :: held 2.787s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Created reservations ['0dcf2bc6-d574-4b6a-a1ad-e143df2fcc26', 'aeccfa2c-a552-4821-9983-99bf5ff2a5a5', '74d173ce-c28d-4acc-9d85-9d29531bcb78', '572a8c06-33d1-49d4-a641-e258a6e04b0e', '188398b4-38e4-4cb6-81aa-0a609e22965d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:12 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11b70fa7-0524-4d78-9216-badc43f33057" returned: 0 in 0.520s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Lock "cinder-quobyte-11b70fa7-0524-4d78-9216-badc43f33057" released by "delete_volume" :: held 1.446s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:12 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Delete snapshot completed successfully. Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-76908dfa-24f6-439b-a417-4bccb67bcea6-delete_snapshot" released by "delete_snapshot" :: held 3.147s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-bd038e97-2b15-4db2-8776-37d489350684-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-bd038e97-2b15-4db2-8776-37d489350684-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Created reservations ['7faf1a39-cac4-4173-abbe-125a65ee3262', 'e0dc68e6-1e5a-4fa0-b238-c45a0d20e431', '1a71f18a-32ce-43b4-b087-ce848727bc0a', '5bec86a0-6092-411e-8260-808a3d5c8128', '75f12bf7-9af3-4d2f-a90b-4712aadda3bf'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-36e93be1-36eb-4c52-b5cf-e704a42d3acd" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-36e93be1-36eb-4c52-b5cf-e704a42d3acd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-bd038e97-2b15-4db2-8776-37d489350684" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-bd038e97-2b15-4db2-8776-37d489350684" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Deleting offline snapshot bd038e97-2b15-4db2-8776-37d489350684 of volume 36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] snapshot_file for this snap is: volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a665432-4c25-4150-9471-c3b92175bdb9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:12 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:16:12 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 Sep 23 00:16:12 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:12 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:13 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:13 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.499s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:13 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684" returned: 0 in 0.631s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:13 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Deleted volume successfully. Sep 23 00:16:13 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7523ce0-027f-4a62-9c90-0ded18b5c216]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6d349f24-d38d-4888-ab73-491d85a120cf tempest-TaggedAttachmentsTest-116161863 None] Lock "cinder-11b70fa7-0524-4d78-9216-badc43f33057-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:13 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd Sep 23 00:16:13 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:13 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd" returned: 0 in 0.444s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:13 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 Sep 23 00:16:13 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:14 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684" returned: 0 in 0.653s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:14 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684 Sep 23 00:16:14 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:14 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd.bd038e97-2b15-4db2-8776-37d489350684" returned: 0 in 0.503s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-bd038e97-2b15-4db2-8776-37d489350684" released by "_delete_snapshot" :: held 2.433s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-36e93be1-36eb-4c52-b5cf-e704a42d3acd" released by "delete_snapshot" :: held 2.475s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:15 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Created reservations ['3229e43b-642d-4f9a-b1d0-5bb014de0c6a', '225bec62-2322-4e4e-b6da-11a3a5729a6b', '7a332729-c072-4a77-aa8c-38fc62c6bdd5', 'ab179b86-fae1-4691-8858-d57387d4aefa', 'd6bd2039-caeb-48cf-85ef-9a40121094f4'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:15 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Delete snapshot completed successfully. Sep 23 00:16:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-bd038e97-2b15-4db2-8776-37d489350684-delete_snapshot" released by "delete_snapshot" :: held 2.819s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Snapshots deleted, issuing volume delete {{(pid=87138) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:16:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-36e93be1-36eb-4c52-b5cf-e704a42d3acd" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-36e93be1-36eb-4c52-b5cf-e704a42d3acd" acquired by "delete_volume" :: waited 0.031s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:15 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c6effa-7b44-4f4d-81f6-3136c36947f5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:15 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd Sep 23 00:16:15 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:16 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd" returned: 0 in 0.584s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:16 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd Sep 23 00:16:16 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:16 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-36e93be1-36eb-4c52-b5cf-e704a42d3acd" returned: 0 in 0.432s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-36e93be1-36eb-4c52-b5cf-e704a42d3acd" released by "delete_volume" :: held 1.146s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Created reservations ['4fc6a4fc-979c-4a83-88a2-dfc260e4e1fb', '4ba8bce9-9e0a-48e5-a61a-3a99a3ae2ee6', 'e9d34264-8b26-4518-b1f4-b0d43bdf5a51', 'b7428e08-55bf-438d-895e-971e10994307', '23ef0f72-fc69-4f94-84c3-5a2b9576abdf'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:16 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:16:16 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:17 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.298s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:17 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Deleted volume successfully. Sep 23 00:16:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-158a63e2-6142-44db-b335-8b8a091c0e6c tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-36e93be1-36eb-4c52-b5cf-e704a42d3acd-delete_volume" released by "delete_volume" :: held 7.926s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Flow 'volume_create_manager' (1730d802-5997-41a6-8bb2-2eb27a8eb8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09337c8c-d869-451d-a7e9-34363d127136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09337c8c-d869-451d-a7e9-34363d127136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-846299241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e20cb35-e292-4798-9bf1-46ce8a5322c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43aac18f28474b38af4e6e8cce0b1830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:19Z,use_quota=True,user_id='d294fad719744d68a4a0d20644d1dddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3883dfb6-2a92-4cea-a0ce-fda564f27f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3883dfb6-2a92-4cea-a0ce-fda564f27f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e682229-fc9f-40f0-b165-efbcd6ba0348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e682229-fc9f-40f0-b165-efbcd6ba0348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e20cb35-e292-4798-9bf1-46ce8a5322c4', 'volume_name': 'volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19befb40-8400-403d-94ad-fa6683218c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19befb40-8400-403d-94ad-fa6683218c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e098cded-65e9-44b7-9ccb-5da8987d2cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:19 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Volume 2e20cb35-e292-4798-9bf1-46ce8a5322c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4', 'volume_size': 1} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-846299241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e20cb35-e292-4798-9bf1-46ce8a5322c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43aac18f28474b38af4e6e8cce0b1830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:19Z,use_quota=True,user_id='d294fad719744d68a4a0d20644d1dddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Creating volume 2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:19 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:19 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 1073741824 Sep 23 00:16:19 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Flow 'volume_create_manager' (7e6a5916-2fee-40a4-a3b0-409f01072fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4234a20f-6266-4187-9435-ea64ed4be8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4234a20f-6266-4187-9435-ea64ed4be8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1414633305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b408361-5cc6-48aa-9f76-ddd217eda2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f25c4a2bf04b66b267ef5508a6d668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:19Z,use_quota=True,user_id='21d82af02ece4cb28f432e479385d12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199e8cd5-b7ef-4077-847a-0ae84ae708a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (199e8cd5-b7ef-4077-847a-0ae84ae708a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1f2335-78e9-4131-aef8-7e38fa7f0f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:19 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:16:20 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 1073741824" returned: 0 in 0.971s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=132,cinder:UPDATE=140,cinder:INSERT=37,cinder:DELETE=6 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=135,cinder:UPDATE=138,cinder:INSERT=30,cinder:DELETE=10 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:20 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 Sep 23 00:16:20 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:20 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4" returned: 0 in 0.518s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e098cded-65e9-44b7-9ccb-5da8987d2cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73097724-8ee4-4abc-831b-63aea7014a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Volume volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 (2e20cb35-e292-4798-9bf1-46ce8a5322c4): created successfully Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73097724-8ee4-4abc-831b-63aea7014a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Flow 'volume_create_manager' (1730d802-5997-41a6-8bb2-2eb27a8eb8dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5216b73d-80f7-4ed5-9802-61a5d5f601d7 tempest-VolumesDeleteCascade-871597615 None] Created volume successfully. Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1f2335-78e9-4131-aef8-7e38fa7f0f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b408361-5cc6-48aa-9f76-ddd217eda2d4', 'volume_name': 'volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06cf4f4f-1358-4a86-a60e-e72a3a5b919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06cf4f4f-1358-4a86-a60e-e72a3a5b919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d68c9e0-87a6-480e-a22e-a45974a32937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:20 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Volume 1b408361-5cc6-48aa-9f76-ddd217eda2d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:16:20 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Trying to clone 1b408361-5cc6-48aa-9f76-ddd217eda2d4 from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:16:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Creating offline snapshot e4d69310-b463-41f0-a1c3-e3d5afadc03e of volume 2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:16:21 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b1d5ea-8775-4465-8f3d-1a1408b6ce2b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:21 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:16:21 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:16:21 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d522ad-b9fb-4a31-a1dc-ee7bd772cd17]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:21 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 Sep 23 00:16:21 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:21 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD Sep 23 00:16:22 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4" returned: 0 in 0.664s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:22 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:22 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb is fetched for user 21d82af02ece4cb28f432e479385d12e. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:16:22 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e 1G Sep 23 00:16:22 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e80d846-f554-4cdb-8178-7712c90bd29d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:22 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD Sep 23 00:16:22 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:22 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:23 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e 1G" returned: 0 in 0.784s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:23 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e Sep 23 00:16:23 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:23 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e" returned: 0 in 0.402s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:23 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e is being set with open permissions: ugo+rw Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:23 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e Sep 23 00:16:23 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Flow 'volume_create_manager' (425927e9-bb8b-4d84-bb41-0c77fcdb5eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef61a86-28d8-4cc7-87d8-95a1d7c2ef57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef61a86-28d8-4cc7-87d8-95a1d7c2ef57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1460078754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171ea43f-dca3-4fe9-8fb6-e3d2e324edcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c46185aed244dc084b84cb77beb8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:23Z,use_quota=True,user_id='de64b8d934754db99b099da3d27fee77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e0b11-5e2c-43fd-b9d8-2df5f6761512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5e0b11-5e2c-43fd-b9d8-2df5f6761512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd55612-3d66-40dc-b096-b06a971bbdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dd55612-3d66-40dc-b096-b06a971bbdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '171ea43f-dca3-4fe9-8fb6-e3d2e324edcc', 'volume_name': 'volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a484e934-0dcf-49f0-9a27-e6c4357918e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a484e934-0dcf-49f0-9a27-e6c4357918e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cf6887-562e-4230-8910-fe918f858cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Volume 171ea43f-dca3-4fe9-8fb6-e3d2e324edcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc', 'volume_size': 1} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:23 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e" returned: 0 in 0.332s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:23 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.info Sep 23 00:16:23 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.info" returned: 0 in 0.330s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:24 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.info is being set with open permissions: ugo+rw Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:24 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.info Sep 23 00:16:24 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.info" returned: 0 in 0.366s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.077s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.633s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1414633305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b408361-5cc6-48aa-9f76-ddd217eda2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1f25c4a2bf04b66b267ef5508a6d668',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:19Z,use_quota=True,user_id='21d82af02ece4cb28f432e479385d12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Creating volume 1b408361-5cc6-48aa-9f76-ddd217eda2d4 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:24 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:16:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:24 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 1073741824 Sep 23 00:16:24 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5619fa96-8692-4579-ab4d-4100b086f8e9 tempest-VolumesDeleteCascade-871597615 None] Create snapshot completed successfully Sep 23 00:16:25 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 1073741824" returned: 0 in 0.521s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:25 devstack sudo[91563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 Sep 23 00:16:25 devstack sudo[91563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:25 devstack sudo[91563]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4" returned: 0 in 0.280s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.791s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1460078754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171ea43f-dca3-4fe9-8fb6-e3d2e324edcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c46185aed244dc084b84cb77beb8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:23Z,use_quota=True,user_id='de64b8d934754db99b099da3d27fee77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Creating volume 171ea43f-dca3-4fe9-8fb6-e3d2e324edcc {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:25 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:25 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc 1073741824 Sep 23 00:16:25 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Attempting download of 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume 1b408361-5cc6-48aa-9f76-ddd217eda2d4. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9132002f-4ceb-4b4a-a1c5-2f000ad78db1]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_48wxx_uw {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:25 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_48wxx_uw Sep 23 00:16:25 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:26 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc 1073741824" returned: 0 in 0.553s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:26 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_48wxx_uw" returned: 0 in 0.472s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_48wxx_uw {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:26 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc Sep 23 00:16:26 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:26 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_48wxx_uw Sep 23 00:16:26 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:26 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc" returned: 0 in 0.437s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:26 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_48wxx_uw" returned: 1 in 0.430s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_48wxx_uw' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e959b00e-642e-48f2-a169-09a0a4e3b39e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cf6887-562e-4230-8910-fe918f858cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdcc286-8790-43cb-a01d-4786ce72a0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Volume volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc (171ea43f-dca3-4fe9-8fb6-e3d2e324edcc): created successfully Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cdcc286-8790-43cb-a01d-4786ce72a0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Flow 'volume_create_manager' (425927e9-bb8b-4d84-bb41-0c77fcdb5eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Flow 'volume_create_manager' (506a0712-0201-48bb-a0ff-86032fa94b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fdf3a1-2db7-4235-bb70-4e383c88c8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD Sep 23 00:16:26 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-dbfdfad2-a999-4476-a38c-01de5d1146fd tempest-VolumeQuotasAdminTestJSON-1051439967 None] Created volume successfully. Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fdf3a1-2db7-4235-bb70-4e383c88c8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-584490270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1479888-312a-41a9-8239-d205888c7990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43aac18f28474b38af4e6e8cce0b1830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e4d69310-b463-41f0-a1c3-e3d5afadc03e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:26Z,use_quota=True,user_id='d294fad719744d68a4a0d20644d1dddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685f5b30-0ae5-4146-b114-567486a86631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (685f5b30-0ae5-4146-b114-567486a86631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dee53f-91f7-4388-b6a3-b2a6562fa703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9dee53f-91f7-4388-b6a3-b2a6562fa703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a1479888-312a-41a9-8239-d205888c7990', 'volume_name': 'volume-a1479888-312a-41a9-8239-d205888c7990', 'volume_size': 1, 'snapshot_id': 'e4d69310-b463-41f0-a1c3-e3d5afadc03e'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850d3284-3121-45a2-8886-c2667ecd98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850d3284-3121-45a2-8886-c2667ecd98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f8a845-76c4-4860-9d3a-52d6891496eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Volume a1479888-312a-41a9-8239-d205888c7990: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a1479888-312a-41a9-8239-d205888c7990', 'volume_size': 1, 'snapshot_id': 'e4d69310-b463-41f0-a1c3-e3d5afadc03e'} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-e4d69310-b463-41f0-a1c3-e3d5afadc03e-a1479888-312a-41a9-8239-d205888c7990" by "_create_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Acquiring lock "cinder-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-e4d69310-b463-41f0-a1c3-e3d5afadc03e-a1479888-312a-41a9-8239-d205888c7990" acquired by "_create_volume_from_snapshot" :: waited 0.064s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Creating volume a1479888-312a-41a9-8239-d205888c7990 from snapshot e4d69310-b463-41f0-a1c3-e3d5afadc03e {{(pid=87138) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-a1479888-312a-41a9-8239-d205888c7990" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "cinder-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-a1479888-312a-41a9-8239-d205888c7990" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] snapshot: e4d69310-b463-41f0-a1c3-e3d5afadc03e, volume: a1479888-312a-41a9-8239-d205888c7990, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Acquiring lock "cinder-quobyte-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae14991d-7e45-4c92-af0d-0acfdac9f0fa]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:27 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD" returned: 0 in 0.616s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb was qcow2, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "cinder-quobyte-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc" acquired by "delete_volume" :: waited 0.063s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:27 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 Sep 23 00:16:27 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e75b952-c9c1-46f9-83fd-93421bc17b98]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:27 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e Sep 23 00:16:27 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:27 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc Sep 23 00:16:27 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:27 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc" returned: 0 in 0.494s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:27 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e" returned: 0 in 0.623s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9de6e-cd22-44c3-8f8d-4727b03b329b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:27 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc Sep 23 00:16:27 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack sudo[91605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 Sep 23 00:16:28 devstack sudo[91605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc" returned: 0 in 0.517s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "cinder-quobyte-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc" released by "delete_volume" :: held 1.082s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Created reservations ['8c8f2531-1117-44dc-b7b0-410ea4429a5a', '64f8ead3-ae00-4b8d-a814-7176b8ee9ce1', '0c7bf717-31d0-4e7e-b80c-b8195651b8e8', 'e660df76-7f9f-432e-b703-0cb44622c34a', 'e60d474a-2d79-47fa-aab4-3c98e12b657f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:28 devstack sudo[91605]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4" returned: 0 in 0.724s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[91617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 Sep 23 00:16:28 devstack sudo[91617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:28 devstack sudo[91619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:16:28 devstack sudo[91619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:29 devstack sudo[91619]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.409s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:29 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Deleted volume successfully. Sep 23 00:16:29 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-40a57db6-15fb-4f69-a13f-acdfec367a7c tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "cinder-171ea43f-dca3-4fe9-8fb6-e3d2e324edcc-delete_volume" released by "delete_volume" :: held 2.084s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:30 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:16:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Flow 'volume_create_manager' (b8effc43-733d-4a9d-80f2-d50a1b078a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49bcbc4-bcc8-4035-b822-2b8be7749533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49bcbc4-bcc8-4035-b822-2b8be7749533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-358829741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d61f981-9580-4b6c-9318-9d05fa8ffabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c46185aed244dc084b84cb77beb8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:31Z,use_quota=True,user_id='de64b8d934754db99b099da3d27fee77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203c632a-91b3-4b98-92e6-2d2561986e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203c632a-91b3-4b98-92e6-2d2561986e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ca86a1-2fd7-472f-91d8-8ef9aa738fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ca86a1-2fd7-472f-91d8-8ef9aa738fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d61f981-9580-4b6c-9318-9d05fa8ffabe', 'volume_name': 'volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6074bbe1-6143-4e18-9e2f-4ba7772e4f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6074bbe1-6143-4e18-9e2f-4ba7772e4f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a18b06-0948-4a78-998b-5a2d93e9a153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:31 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Volume 1d61f981-9580-4b6c-9318-9d05fa8ffabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe', 'volume_size': 1} Sep 23 00:16:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:31 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4" returned: 0 in 4.397s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:31 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_6661tctjdevstack@QuobyteHD, size 112.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:16:31 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Converted 112.00 MB image at 25.44 MB/s Sep 23 00:16:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:31 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 1G Sep 23 00:16:31 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:32 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 1G" returned: 0 in 0.845s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:32 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Downloaded image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume 1b408361-5cc6-48aa-9f76-ddd217eda2d4 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:16:32 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb for user 21d82af02ece4cb28f432e479385d12e is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:16:32 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Marking volume 1b408361-5cc6-48aa-9f76-ddd217eda2d4 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:16:32 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Copying metadata from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb to 1b408361-5cc6-48aa-9f76-ddd217eda2d4. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:16:32 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Creating volume glance metadata for volume 1b408361-5cc6-48aa-9f76-ddd217eda2d4 backed by image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:16:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d68c9e0-87a6-480e-a22e-a45974a32937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed178617-efb4-4a17-aee0-b7f20cfa3da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:33 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Volume volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 (1b408361-5cc6-48aa-9f76-ddd217eda2d4): created successfully Sep 23 00:16:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed178617-efb4-4a17-aee0-b7f20cfa3da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Flow 'volume_create_manager' (7e6a5916-2fee-40a4-a3b0-409f01072fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-dab0c58f-e620-47e1-a198-1a4d246425ae tempest-ServerActionsTestOtherA-2073692176 None] Created volume successfully. Sep 23 00:16:39 devstack sudo[91617]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990" returned: 0 in 10.799s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4, size 1024.00 MB, duration 10.80 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:16:39 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Converted 1024.00 MB image at 94.79 MB/s Sep 23 00:16:39 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 is being set with open permissions: ugo+rw Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:39 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 Sep 23 00:16:39 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:39 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990" returned: 0 in 0.383s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-a1479888-312a-41a9-8239-d205888c7990" released by "_copy_volume_from_snapshot" :: held 12.686s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-e4d69310-b463-41f0-a1c3-e3d5afadc03e-a1479888-312a-41a9-8239-d205888c7990" released by "_create_volume_from_snapshot" :: held 12.832s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.902s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.801s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-358829741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d61f981-9580-4b6c-9318-9d05fa8ffabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c46185aed244dc084b84cb77beb8c18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:16:31Z,use_quota=True,user_id='de64b8d934754db99b099da3d27fee77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Creating volume 1d61f981-9580-4b6c-9318-9d05fa8ffabe {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:16:39 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:39 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe 1073741824 Sep 23 00:16:39 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f8a845-76c4-4860-9d3a-52d6891496eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1479888-312a-41a9-8239-d205888c7990', 'volume_size': 1, 'snapshot_id': 'e4d69310-b463-41f0-a1c3-e3d5afadc03e'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39291bd-bfeb-418d-8832-00c53e126364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:40 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Volume volume-a1479888-312a-41a9-8239-d205888c7990 (a1479888-312a-41a9-8239-d205888c7990): created successfully Sep 23 00:16:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39291bd-bfeb-418d-8832-00c53e126364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Flow 'volume_create_manager' (506a0712-0201-48bb-a0ff-86032fa94b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-42cf25b0-551f-4ae4-9a9c-7bd98c441bd9 tempest-VolumesDeleteCascade-871597615 None] Created volume successfully. Sep 23 00:16:40 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe 1073741824" returned: 0 in 0.903s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:40 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe Sep 23 00:16:40 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-e1650a81-c5a6-4aee-a253-3dba1de87237 req-10b9eadd-0772-4504-b1f7-cfc75583029a tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-2e20cb35-e292-4798-9bf1-46ce8a5322c4-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-2e20cb35-e292-4798-9bf1-46ce8a5322c4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Performing cascade delete. {{(pid=87138) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-e4d69310-b463-41f0-a1c3-e3d5afadc03e-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-e4d69310-b463-41f0-a1c3-e3d5afadc03e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-2e20cb35-e292-4798-9bf1-46ce8a5322c4" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-2e20cb35-e292-4798-9bf1-46ce8a5322c4" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-e4d69310-b463-41f0-a1c3-e3d5afadc03e" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-e4d69310-b463-41f0-a1c3-e3d5afadc03e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Deleting offline snapshot e4d69310-b463-41f0-a1c3-e3d5afadc03e of volume 2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:16:41 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] snapshot_file for this snap is: volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe" returned: 0 in 0.473s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-e1650a81-c5a6-4aee-a253-3dba1de87237 req-10b9eadd-0772-4504-b1f7-cfc75583029a tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.434s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d2365b-3f8e-4668-941f-4fcf2fe2f9cd]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a18b06-0948-4a78-998b-5a2d93e9a153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca21569-50d1-4a96-a62d-4d87ab286e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-e1650a81-c5a6-4aee-a253-3dba1de87237 req-10b9eadd-0772-4504-b1f7-cfc75583029a tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.096s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Volume volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe (1d61f981-9580-4b6c-9318-9d05fa8ffabe): created successfully Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ca21569-50d1-4a96-a62d-4d87ab286e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Flow 'volume_create_manager' (b8effc43-733d-4a9d-80f2-d50a1b078a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:16:41 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fcee87a9-db0c-4bfd-bf2e-37e1db2bc6a1 tempest-VolumeQuotasAdminTestJSON-1051439967 None] Created volume successfully. Sep 23 00:16:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-e1650a81-c5a6-4aee-a253-3dba1de87237 req-10b9eadd-0772-4504-b1f7-cfc75583029a tempest-ServerActionsTestOtherA-2073692176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adf05476-f0d5-4b7f-b5f3-7214b525625e', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:16:41 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-e1650a81-c5a6-4aee-a253-3dba1de87237 req-10b9eadd-0772-4504-b1f7-cfc75583029a tempest-ServerActionsTestOtherA-2073692176 None] attachment_update completed successfully. Sep 23 00:16:41 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e Sep 23 00:16:41 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:42 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e" returned: 0 in 0.986s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:16:42 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d02246-a4f3-4a67-ace5-b632f2cf0ad3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:42 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 Sep 23 00:16:42 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:43 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4" returned: 0 in 0.894s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:43 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e Sep 23 00:16:43 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:43 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6a74f1bd-9d65-48ae-b7d2-bb444a927782 tempest-VolumeQuotasAdminTestJSON-1700582338 None] Transfer volume completed successfully. Sep 23 00:16:43 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e" returned: 0 in 0.601s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:43 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e Sep 23 00:16:43 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:44 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Acquiring lock "cinder-1d61f981-9580-4b6c-9318-9d05fa8ffabe-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4.e4d69310-b463-41f0-a1c3-e3d5afadc03e" returned: 0 in 0.626s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Lock "cinder-1d61f981-9580-4b6c-9318-9d05fa8ffabe-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-e4d69310-b463-41f0-a1c3-e3d5afadc03e" released by "_delete_snapshot" :: held 3.370s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-2e20cb35-e292-4798-9bf1-46ce8a5322c4" released by "delete_snapshot" :: held 3.414s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Acquiring lock "cinder-quobyte-1d61f981-9580-4b6c-9318-9d05fa8ffabe" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Lock "cinder-quobyte-1d61f981-9580-4b6c-9318-9d05fa8ffabe" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1eeea8-1d82-4b51-9ec6-df9542abf7d8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:44 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Created reservations ['b03d5b44-6256-4598-8618-441180105001', 'fb4578e8-e42a-466a-a73a-7a230bced0b5', '529dcf77-f442-4187-9996-1bebe13bd05d', 'b8998cb0-f5e8-4b54-a3a7-c43a7af37a8a', '7731eb18-24a1-4771-bd75-8e2bdf23f243'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:45 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe Sep 23 00:16:45 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:45 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Delete snapshot completed successfully. Sep 23 00:16:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-e4d69310-b463-41f0-a1c3-e3d5afadc03e-delete_snapshot" released by "delete_snapshot" :: held 3.943s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Snapshots deleted, issuing volume delete {{(pid=87138) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 23 00:16:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-2e20cb35-e292-4798-9bf1-46ce8a5322c4" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-2e20cb35-e292-4798-9bf1-46ce8a5322c4" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:45 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec917fb2-4523-43a1-8070-f82fb3f15174]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:45 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 Sep 23 00:16:45 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:45 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe" returned: 0 in 0.770s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:45 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe Sep 23 00:16:45 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:46 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4" returned: 0 in 0.877s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:46 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4 Sep 23 00:16:46 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:46 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d61f981-9580-4b6c-9318-9d05fa8ffabe" returned: 0 in 0.766s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Lock "cinder-quobyte-1d61f981-9580-4b6c-9318-9d05fa8ffabe" released by "delete_volume" :: held 1.622s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Created reservations ['d90d8093-b2be-4ffa-97f4-6ceeb1147fac', '6bb6005c-e7e9-4bff-a983-7dd7cbf0f60a', 'e84b2134-f5e6-481a-8068-e5783a030460', '8e30dbbd-92dd-4b1a-bc3e-6204836e225f', '336af736-de2d-4b31-a7f3-08459d82bd19'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:46 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:46 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:16:46 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e20cb35-e292-4798-9bf1-46ce8a5322c4" returned: 0 in 0.589s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-2e20cb35-e292-4798-9bf1-46ce8a5322c4" released by "delete_volume" :: held 1.630s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:46 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Created reservations ['1ce4751c-410a-49f2-976c-9ad0378642d2', '149b66b2-94b3-4903-a609-3ce261f75949', 'c3997450-8ab3-4c44-b548-31da63b26539', '77f838c7-5dc4-4b45-895f-444739c92e56', 'a079f630-9d33-454b-b70a-4a18b456d77d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:47 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:16:47 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:47 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.602s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Deleted volume successfully. Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d56a2740-7b63-4d2f-94e9-e3a4ef5f737f tempest-VolumeQuotasAdminTestJSON-1011223083 None] Lock "cinder-1d61f981-9580-4b6c-9318-9d05fa8ffabe-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:47 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.547s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Deleted volume successfully. Sep 23 00:16:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a19a0480-736e-42f7-83ca-853f4b603601 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-2e20cb35-e292-4798-9bf1-46ce8a5322c4-delete_volume" released by "delete_volume" :: held 6.633s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-a1479888-312a-41a9-8239-d205888c7990-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-a1479888-312a-41a9-8239-d205888c7990-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "cinder-quobyte-a1479888-312a-41a9-8239-d205888c7990" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:16:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-a1479888-312a-41a9-8239-d205888c7990" acquired by "delete_volume" :: waited 0.052s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:16:48 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[012ec7bb-cd8a-4e4e-a00e-d02a1f05f7e9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:16:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:49 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 Sep 23 00:16:49 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:49 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990" returned: 0 in 1.110s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:50 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990 Sep 23 00:16:50 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:50 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a1479888-312a-41a9-8239-d205888c7990" returned: 0 in 0.612s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-quobyte-a1479888-312a-41a9-8239-d205888c7990" released by "delete_volume" :: held 1.909s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:16:50 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Created reservations ['0fef5f6e-850a-48bf-86c4-be5251e47f44', 'de9edf65-e08d-4288-b93f-f8c29a3f3e34', '8ab3555c-b55f-4bd6-a4be-c8c0accfa1d5', '44b0146c-292d-451d-8e56-4feffa364e0c', 'ac2caefd-78b9-47a7-8e62-dabd8a1071c1'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:16:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:16:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:16:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:16:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:16:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:16:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:16:51 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:16:51 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:16:51 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Sep 23 00:16:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.690s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:16:51 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:16:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Deleted volume successfully. Sep 23 00:16:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ba5bc247-d1dd-4d0e-a7ed-67f6dd25bcb2 tempest-VolumesDeleteCascade-871597615 None] Lock "cinder-a1479888-312a-41a9-8239-d205888c7990-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:01 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=53,cinder:DELETE=5,cinder:SELECT=57,cinder:INSERT=16 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:01 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=58,cinder:INSERT=28,cinder:UPDATE=68,cinder:DELETE=5 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:17:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:02 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:17:02 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:03 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.867s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Flow 'volume_create_manager' (de0b70c5-0229-44b8-b58c-587ca19702e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cee021-7496-4da2-9465-8ae4ccb0c51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cee021-7496-4da2-9465-8ae4ccb0c51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-888114031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1f951c-3d5d-4238-8dce-5fd0103bba8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077960dfa89c4412996b3a6378b111f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:12Z,use_quota=True,user_id='b03ab2aafd59407e8149337602c7cd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01da2a84-07d1-48b3-a946-890d0150623b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01da2a84-07d1-48b3-a946-890d0150623b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6791db-b7ff-410a-a4c8-f443b7f74efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6791db-b7ff-410a-a4c8-f443b7f74efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff1f951c-3d5d-4238-8dce-5fd0103bba8b', 'volume_name': 'volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d29170-0c03-429e-b45c-aac981eb7b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d29170-0c03-429e-b45c-aac981eb7b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f42c9a8-4858-4ee1-bd77-da58ea22590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:12 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Volume ff1f951c-3d5d-4238-8dce-5fd0103bba8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b', 'volume_size': 1} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-888114031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff1f951c-3d5d-4238-8dce-5fd0103bba8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077960dfa89c4412996b3a6378b111f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:12Z,use_quota=True,user_id='b03ab2aafd59407e8149337602c7cd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Creating volume ff1f951c-3d5d-4238-8dce-5fd0103bba8b {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:12 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:17:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:12 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b 1073741824 Sep 23 00:17:12 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b 1073741824" returned: 0 in 1.038s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:13 devstack sudo[92313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b Sep 23 00:17:13 devstack sudo[92313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:13 devstack sudo[92313]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b" returned: 0 in 0.562s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f42c9a8-4858-4ee1-bd77-da58ea22590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e9b773-93e1-40e0-8e84-50eb644fd3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:13 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Volume volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b (ff1f951c-3d5d-4238-8dce-5fd0103bba8b): created successfully Sep 23 00:17:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e9b773-93e1-40e0-8e84-50eb644fd3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Flow 'volume_create_manager' (de0b70c5-0229-44b8-b58c-587ca19702e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:14 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f85b6d23-6cf8-4c3e-a1ce-da7bf371cc2f tempest-VolumesTransfersV355Test-1335863822 None] Created volume successfully. Sep 23 00:17:14 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-74488ed7-a776-45ff-a276-5608d9f39fc9 req-3c99b6ae-608a-49fb-af3c-f11c43910373 tempest-ServerActionsTestOtherA-2073692176 None] Terminate volume connection completed successfully. Sep 23 00:17:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-74488ed7-a776-45ff-a276-5608d9f39fc9 req-3c99b6ae-608a-49fb-af3c-f11c43910373 tempest-ServerActionsTestOtherA-2073692176 None] Deleting attachment adf05476-f0d5-4b7f-b5f3-7214b525625e. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Flow 'volume_create_manager' (f3811afd-cd0e-4b62-af5a-f7a1762b2574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fed410-bf04-4844-b954-ff201a9070d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fed410-bf04-4844-b954-ff201a9070d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1186954398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f62257-7a1f-4092-85a9-ef41df9ed7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dcd97a9b6640e0972914068b265896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:15Z,use_quota=True,user_id='31ef6cb5834e4fe69fe73de71c6919cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e62c956-7f3c-41c5-a4ba-87076ec72df5),volume_type_id=8e62c956-7f3c-41c5-a4ba-87076ec72df5)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28398f9e-0bb5-410a-a0e4-3ef02a8c2884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28398f9e-0bb5-410a-a0e4-3ef02a8c2884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cd77f1-5c7d-443a-ab92-38ce80131cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2cd77f1-5c7d-443a-ab92-38ce80131cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f62257-7a1f-4092-85a9-ef41df9ed7f9', 'volume_name': 'volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e03c61a-52b6-44cc-8b71-ff0bfaf24b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e03c61a-52b6-44cc-8b71-ff0bfaf24b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b90a337-65c9-4cfe-ac2c-b3e85d9b328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:15 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Volume 10f62257-7a1f-4092-85a9-ef41df9ed7f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9', 'volume_size': 1} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1186954398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f62257-7a1f-4092-85a9-ef41df9ed7f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47dcd97a9b6640e0972914068b265896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:15Z,use_quota=True,user_id='31ef6cb5834e4fe69fe73de71c6919cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e62c956-7f3c-41c5-a4ba-87076ec72df5),volume_type_id=8e62c956-7f3c-41c5-a4ba-87076ec72df5)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Creating volume 10f62257-7a1f-4092-85a9-ef41df9ed7f9 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:15 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:17:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:15 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 1073741824 Sep 23 00:17:15 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:16 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 1073741824" returned: 0 in 1.056s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:16 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 Sep 23 00:17:16 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:16 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a70a4725-9737-4ddd-bdc7-8028bddda961 tempest-VolumesTransfersV355Test-138310763 None] Transfer volume completed successfully. Sep 23 00:17:17 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9" returned: 0 in 0.407s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b90a337-65c9-4cfe-ac2c-b3e85d9b328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fef7835-c5c5-44e7-b15e-51f4ac1e3c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:17 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Volume volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 (10f62257-7a1f-4092-85a9-ef41df9ed7f9): created successfully Sep 23 00:17:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fef7835-c5c5-44e7-b15e-51f4ac1e3c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Flow 'volume_create_manager' (f3811afd-cd0e-4b62-af5a-f7a1762b2574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-583ff67c-0e60-40d4-996f-17b407c4e217 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Created volume successfully. Sep 23 00:17:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Acquiring lock "cinder-ff1f951c-3d5d-4238-8dce-5fd0103bba8b-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Lock "cinder-ff1f951c-3d5d-4238-8dce-5fd0103bba8b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Acquiring lock "cinder-quobyte-ff1f951c-3d5d-4238-8dce-5fd0103bba8b" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Lock "cinder-quobyte-ff1f951c-3d5d-4238-8dce-5fd0103bba8b" acquired by "delete_volume" :: waited 0.057s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b103aa0f-ab43-4767-8551-13622a396a52]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-74488ed7-a776-45ff-a276-5608d9f39fc9 req-a8235978-2916-4512-a611-0fd9c99484e4 tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-74488ed7-a776-45ff-a276-5608d9f39fc9 req-a8235978-2916-4512-a611-0fd9c99484e4 tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:18 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b Sep 23 00:17:18 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-74488ed7-a776-45ff-a276-5608d9f39fc9 req-a8235978-2916-4512-a611-0fd9c99484e4 tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-74488ed7-a776-45ff-a276-5608d9f39fc9 req-a8235978-2916-4512-a611-0fd9c99484e4 tempest-ServerActionsTestOtherA-2073692176 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9494f103-9cdb-4ac7-9ab4-081d19b4de22', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:17:18 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-74488ed7-a776-45ff-a276-5608d9f39fc9 req-a8235978-2916-4512-a611-0fd9c99484e4 tempest-ServerActionsTestOtherA-2073692176 None] attachment_update completed successfully. Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e39e7a4-6bf2-47be-a252-76957649d29e tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e39e7a4-6bf2-47be-a252-76957649d29e tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2e39e7a4-6bf2-47be-a252-76957649d29e tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2e39e7a4-6bf2-47be-a252-76957649d29e tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e39e7a4-6bf2-47be-a252-76957649d29e tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e39e7a4-6bf2-47be-a252-76957649d29e tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:18 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:17:18 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:18 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b" returned: 0 in 0.703s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:18 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b Sep 23 00:17:18 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:19 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e39e7a4-6bf2-47be-a252-76957649d29e tempest-VolumeRetypeWithoutMigrationTest-6692302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.374s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-2e39e7a4-6bf2-47be-a252-76957649d29e tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:19 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2e39e7a4-6bf2-47be-a252-76957649d29e tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Retype volume completed successfully. Sep 23 00:17:19 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ff1f951c-3d5d-4238-8dce-5fd0103bba8b" returned: 0 in 0.469s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Lock "cinder-quobyte-ff1f951c-3d5d-4238-8dce-5fd0103bba8b" released by "delete_volume" :: held 1.268s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Created reservations ['459d6824-eb18-4b9a-ad61-a66f472d7548', '4d780156-c809-43e4-96ae-00708d795067', 'a6ef2489-5fcb-4308-8014-db1b8e87bbe8', '32adedd0-8344-44cf-968f-47a08b40c6c9', '51c0aa54-7883-45cb-9b6b-4ec817bf478c'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:19 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:17:19 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:20 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.507s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:20 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Deleted volume successfully. Sep 23 00:17:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-078506e6-e66c-49be-a26e-624c0b0a640e tempest-VolumesTransfersV355Test-1516268777 None] Lock "cinder-ff1f951c-3d5d-4238-8dce-5fd0103bba8b-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Acquiring lock "cinder-10f62257-7a1f-4092-85a9-ef41df9ed7f9-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "cinder-10f62257-7a1f-4092-85a9-ef41df9ed7f9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Acquiring lock "cinder-quobyte-10f62257-7a1f-4092-85a9-ef41df9ed7f9" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "cinder-quobyte-10f62257-7a1f-4092-85a9-ef41df9ed7f9" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:20 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5334ac13-15cd-4d09-9b2c-2e6567dbbf85]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:21 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 Sep 23 00:17:21 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:22 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9" returned: 0 in 1.317s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:22 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9 Sep 23 00:17:22 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Flow 'volume_create_manager' (66e0e0cf-2c59-4c33-8b21-b8cb91ca04ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6474d43e-9275-4185-9de1-6181ac27a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6474d43e-9275-4185-9de1-6181ac27a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-681967399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b84780-f16f-4f64-b60a-c483a6f6ea7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077960dfa89c4412996b3a6378b111f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:22Z,use_quota=True,user_id='b03ab2aafd59407e8149337602c7cd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85d6b68-c0f3-4020-a446-6cb11865f288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e85d6b68-c0f3-4020-a446-6cb11865f288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b0a08f-6c15-4eb7-a0b7-0816355bc0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b0a08f-6c15-4eb7-a0b7-0816355bc0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b84780-f16f-4f64-b60a-c483a6f6ea7a', 'volume_name': 'volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0565bd8b-30ab-4ecd-b0b8-4e3140439bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0565bd8b-30ab-4ecd-b0b8-4e3140439bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daee429f-83ca-4ae0-9c70-cd60dcbbf99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:22 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Volume a0b84780-f16f-4f64-b60a-c483a6f6ea7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a', 'volume_size': 1} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-681967399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b84780-f16f-4f64-b60a-c483a6f6ea7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077960dfa89c4412996b3a6378b111f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:22Z,use_quota=True,user_id='b03ab2aafd59407e8149337602c7cd00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Creating volume a0b84780-f16f-4f64-b60a-c483a6f6ea7a {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:22 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:17:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:22 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a 1073741824 Sep 23 00:17:22 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:23 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-10f62257-7a1f-4092-85a9-ef41df9ed7f9" returned: 0 in 0.804s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "cinder-quobyte-10f62257-7a1f-4092-85a9-ef41df9ed7f9" released by "delete_volume" :: held 2.265s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:23 devstack cinder-volume[87138]: WARNING cinder.quota [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:17:23 devstack cinder-volume[87138]: WARNING cinder.quota [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:17:23 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Created reservations ['eaccc8fe-5bb6-45a1-a4cb-3372d5851d97', 'ab5c9b9c-98e8-4608-9e54-8f391ade4d94', 'a5cb14cb-1a26-447f-8370-ebf16fb3a530', 'd25eec00-d0bc-4ccc-9310-f585288e90d6', '2d33642f-2027-4eb3-89d3-1cf4feae6b8a'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:23 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:17:23 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:24 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.595s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:24 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Deleted volume successfully. Sep 23 00:17:24 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cfd703f1-a478-48fd-852e-04d5472b0dc3 tempest-VolumeRetypeWithoutMigrationTest-6692302 None] Lock "cinder-10f62257-7a1f-4092-85a9-ef41df9ed7f9-delete_volume" released by "delete_volume" :: held 3.958s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a 1073741824" returned: 0 in 1.833s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:24 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a Sep 23 00:17:24 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:25 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a" returned: 0 in 0.764s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] <== create_volume: return (2821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.829s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daee429f-83ca-4ae0-9c70-cd60dcbbf99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12334056-7586-47d6-9d70-61ac083243f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Volume volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a (a0b84780-f16f-4f64-b60a-c483a6f6ea7a): created successfully Sep 23 00:17:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12334056-7586-47d6-9d70-61ac083243f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Flow 'volume_create_manager' (66e0e0cf-2c59-4c33-8b21-b8cb91ca04ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-415aa2df-3d98-4ac7-bd5f-8c1af8ad3dea tempest-VolumesTransfersV355Test-1335863822 None] Created volume successfully. Sep 23 00:17:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Acquiring lock "cinder-a0b84780-f16f-4f64-b60a-c483a6f6ea7a-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Lock "cinder-a0b84780-f16f-4f64-b60a-c483a6f6ea7a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Acquiring lock "cinder-quobyte-a0b84780-f16f-4f64-b60a-c483a6f6ea7a" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Lock "cinder-quobyte-a0b84780-f16f-4f64-b60a-c483a6f6ea7a" acquired by "delete_volume" :: waited 0.119s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d679a521-e319-4424-a54b-b61167ddfad7]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:28 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a Sep 23 00:17:28 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:29 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a" returned: 0 in 1.515s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:29 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a Sep 23 00:17:29 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a0b84780-f16f-4f64-b60a-c483a6f6ea7a" returned: 0 in 0.640s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:29 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:29 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Lock "cinder-quobyte-a0b84780-f16f-4f64-b60a-c483a6f6ea7a" released by "delete_volume" :: held 2.399s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:30 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Created reservations ['961ea341-29d5-4267-bbe6-47a99313e05a', 'aac5f10e-845a-4ac6-a7af-725362fee1d3', 'fce6d997-4c90-473c-9ba2-7ee7bf8fe282', 'eed92d2b-a426-42b4-97ed-d025eddadaff', '3a31d617-a6f2-48ae-ba1b-7ee64047edf3'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:30 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:17:30 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:31 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.787s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:31 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:17:31 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Deleted volume successfully. Sep 23 00:17:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4091f78b-3806-4ded-83dc-74888716ce87 tempest-VolumesTransfersV355Test-1516268777 None] Lock "cinder-a0b84780-f16f-4f64-b60a-c483a6f6ea7a-delete_volume" released by "delete_volume" :: held 4.193s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:40 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=46,cinder:SELECT=36,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:41 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=43,cinder:UPDATE=39,cinder:DELETE=4,cinder:INSERT=9 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Flow 'volume_create_manager' (a809c315-08ce-4688-80b0-ae2cc59d4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b507c1e2-332b-40e8-96a8-b61b4e9d6196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b507c1e2-332b-40e8-96a8-b61b4e9d6196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-234052046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b351c61b-b2f1-4c8a-9e7b-c33881dea239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921fa8977b2c4369ad63123831a324dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:48Z,use_quota=True,user_id='96e0b1878935409b9d69e56e8cb6cb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b5c920-e60d-4255-b9e1-9edbdc6b51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5b5c920-e60d-4255-b9e1-9edbdc6b51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb22fa9-5730-44ad-a354-9c9852b8545c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb22fa9-5730-44ad-a354-9c9852b8545c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b351c61b-b2f1-4c8a-9e7b-c33881dea239', 'volume_name': 'volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ae453f-7d7e-473a-8f10-3c01d4df71d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ae453f-7d7e-473a-8f10-3c01d4df71d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d942f3a-365d-42bd-b9a9-6d51ed3e297e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:48 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Volume b351c61b-b2f1-4c8a-9e7b-c33881dea239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239', 'volume_size': 1} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-234052046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b351c61b-b2f1-4c8a-9e7b-c33881dea239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='921fa8977b2c4369ad63123831a324dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:48Z,use_quota=True,user_id='96e0b1878935409b9d69e56e8cb6cb2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Creating volume b351c61b-b2f1-4c8a-9e7b-c33881dea239 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:48 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:17:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:48 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 1073741824 Sep 23 00:17:48 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:49 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 1073741824" returned: 0 in 1.064s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:49 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 Sep 23 00:17:49 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:50 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239" returned: 0 in 0.349s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d942f3a-365d-42bd-b9a9-6d51ed3e297e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f270bf1-24f9-45ec-8e51-97fe44edeef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:50 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Volume volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 (b351c61b-b2f1-4c8a-9e7b-c33881dea239): created successfully Sep 23 00:17:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f270bf1-24f9-45ec-8e51-97fe44edeef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Flow 'volume_create_manager' (a809c315-08ce-4688-80b0-ae2cc59d4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:50 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-cb91dfb9-2c48-4501-bcd1-1a17715d8e50 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Created volume successfully. Sep 23 00:17:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Creating offline snapshot f658e90e-ac43-41c6-9d13-2af67bea2b1b of volume b351c61b-b2f1-4c8a-9e7b-c33881dea239 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:17:51 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[813e3761-7881-4597-ad44-77a628616aca]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:51 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 Sep 23 00:17:51 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:51 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Flow 'volume_create_manager' (ef97330f-d156-4644-96da-b8d45177ddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f3fd13-4023-4d74-8e6f-230d795fbb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f3fd13-4023-4d74-8e6f-230d795fbb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-380436702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b2a8f7-3b5c-461d-b30c-b2fe66530512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7beef14820224c49983c3230c20f7ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:52Z,use_quota=True,user_id='6599cb1cf98e43d5b9ec4d446c72b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6544eb3-627a-486d-8820-33d68e3ac362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6544eb3-627a-486d-8820-33d68e3ac362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d62c16-a306-48b2-936a-c7aa939fb563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d62c16-a306-48b2-936a-c7aa939fb563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b2a8f7-3b5c-461d-b30c-b2fe66530512', 'volume_name': 'volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776342f4-db35-4e77-8d58-c98ce6ba016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776342f4-db35-4e77-8d58-c98ce6ba016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815a1ff0-3ca0-4d1d-b66c-14d50eea1c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:52 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Volume 31b2a8f7-3b5c-461d-b30c-b2fe66530512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512', 'volume_size': 1} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:52 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239" returned: 0 in 0.489s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:52 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b 1G Sep 23 00:17:52 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:52 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b 1G" returned: 0 in 0.498s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:52 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b Sep 23 00:17:52 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:53 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b" returned: 0 in 0.343s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:53 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b is being set with open permissions: ugo+rw Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:53 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b Sep 23 00:17:53 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:53 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Flow 'volume_create_manager' (d29e5dc0-ea26-4e7d-8a4e-1d2275886558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799a8a63-1dd7-4358-b9b1-feafb27ddcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799a8a63-1dd7-4358-b9b1-feafb27ddcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1536904419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90f3947-696b-4ee6-b978-95571e0fa021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f25e17c1e04449c893b6b51e0eaaa32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:53Z,use_quota=True,user_id='e5857a0c68a642cabaed2d3b3dcc5d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19725187-9384-45af-b340-94131089c4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19725187-9384-45af-b340-94131089c4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11c5034-76b1-4e8c-a128-0f886a693315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a11c5034-76b1-4e8c-a128-0f886a693315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a90f3947-696b-4ee6-b978-95571e0fa021', 'volume_name': 'volume-a90f3947-696b-4ee6-b978-95571e0fa021', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09e0135-1166-432d-b9c5-20efddd49cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09e0135-1166-432d-b9c5-20efddd49cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40771e8-d7d9-4aeb-af3b-8c1d13a4b0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:53 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Volume a90f3947-696b-4ee6-b978-95571e0fa021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a90f3947-696b-4ee6-b978-95571e0fa021', 'volume_size': 1} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:53 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.info Sep 23 00:17:53 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:53 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.info" returned: 0 in 0.266s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:53 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.info is being set with open permissions: ugo+rw Sep 23 00:17:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:53 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.info Sep 23 00:17:53 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:54 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.info" returned: 0 in 0.256s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-380436702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b2a8f7-3b5c-461d-b30c-b2fe66530512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7beef14820224c49983c3230c20f7ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:52Z,use_quota=True,user_id='6599cb1cf98e43d5b9ec4d446c72b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Creating volume 31b2a8f7-3b5c-461d-b30c-b2fe66530512 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:54 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:54 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 1073741824 Sep 23 00:17:54 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0b6b3c39-d0ac-4bcc-adb2-6f7785ade689 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Create snapshot completed successfully Sep 23 00:17:54 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 1073741824" returned: 0 in 0.490s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:54 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 Sep 23 00:17:54 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:54 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512" returned: 0 in 0.280s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.421s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1536904419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a90f3947-696b-4ee6-b978-95571e0fa021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f25e17c1e04449c893b6b51e0eaaa32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:53Z,use_quota=True,user_id='e5857a0c68a642cabaed2d3b3dcc5d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Creating volume a90f3947-696b-4ee6-b978-95571e0fa021 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:54 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:54 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021 1073741824 Sep 23 00:17:54 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815a1ff0-3ca0-4d1d-b66c-14d50eea1c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91df90b4-763c-448c-a6e1-f34be8c02b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:54 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Volume volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 (31b2a8f7-3b5c-461d-b30c-b2fe66530512): created successfully Sep 23 00:17:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91df90b4-763c-448c-a6e1-f34be8c02b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Flow 'volume_create_manager' (ef97330f-d156-4644-96da-b8d45177ddbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4d5c5e55-b64f-4a2b-a40d-d1d1aa8dd088 tempest-ServersNegativeTestJSON-1477833591 None] Created volume successfully. Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Acquiring lock "cinder-f658e90e-ac43-41c6-9d13-2af67bea2b1b-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-f658e90e-ac43-41c6-9d13-2af67bea2b1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Acquiring lock "cinder-quobyte-b351c61b-b2f1-4c8a-9e7b-c33881dea239" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-quobyte-b351c61b-b2f1-4c8a-9e7b-c33881dea239" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Acquiring lock "cinder-quobyte-f658e90e-ac43-41c6-9d13-2af67bea2b1b" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-quobyte-f658e90e-ac43-41c6-9d13-2af67bea2b1b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Deleting offline snapshot f658e90e-ac43-41c6-9d13-2af67bea2b1b of volume b351c61b-b2f1-4c8a-9e7b-c33881dea239 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] snapshot_file for this snap is: volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e14482-c94d-4c21-bc37-a4c212c6881e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:55 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021 1073741824" returned: 0 in 0.842s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:55 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b Sep 23 00:17:55 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:55 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021 Sep 23 00:17:55 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:56 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021" returned: 0 in 0.396s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40771e8-d7d9-4aeb-af3b-8c1d13a4b0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a90f3947-696b-4ee6-b978-95571e0fa021', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b76fcd-c685-4bc4-877d-44366319dd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:56 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Volume volume-a90f3947-696b-4ee6-b978-95571e0fa021 (a90f3947-696b-4ee6-b978-95571e0fa021): created successfully Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b76fcd-c685-4bc4-877d-44366319dd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Flow 'volume_create_manager' (d29e5dc0-ea26-4e7d-8a4e-1d2275886558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:56 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b" returned: 0 in 0.581s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:17:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f63e7431-b161-4b99-bfb2-b02be9a99571 tempest-VolumesTransfersV357Test-1705485235 None] Created volume successfully. Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef09cd8-6aca-4484-bd64-8ccbad42eaa3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:56 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 Sep 23 00:17:56 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:57 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239" returned: 0 in 0.760s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:57 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b Sep 23 00:17:57 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Flow 'volume_create_manager' (23f473b8-9c82-41d5-bba0-943f496ef644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8ca504-2282-4e92-94d2-fba6d2ffbd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc8ca504-2282-4e92-94d2-fba6d2ffbd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-514234964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d811ac-c212-4fe5-9343-b1e9271e1758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7beef14820224c49983c3230c20f7ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:58Z,use_quota=True,user_id='6599cb1cf98e43d5b9ec4d446c72b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02b2289-f4fb-4de7-bfe9-a1e4d58d6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02b2289-f4fb-4de7-bfe9-a1e4d58d6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391a65b6-c270-4f0b-b6af-754afdf8b3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (391a65b6-c270-4f0b-b6af-754afdf8b3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d811ac-c212-4fe5-9343-b1e9271e1758', 'volume_name': 'volume-c6d811ac-c212-4fe5-9343-b1e9271e1758', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2baba850-533b-4be5-a5d6-7c3a0a30929c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2baba850-533b-4be5-a5d6-7c3a0a30929c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4548a3-5766-48e2-8f0e-edd362783a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:57 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Volume c6d811ac-c212-4fe5-9343-b1e9271e1758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d811ac-c212-4fe5-9343-b1e9271e1758', 'volume_size': 1} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-514234964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d811ac-c212-4fe5-9343-b1e9271e1758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7beef14820224c49983c3230c20f7ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:17:58Z,use_quota=True,user_id='6599cb1cf98e43d5b9ec4d446c72b6aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Creating volume c6d811ac-c212-4fe5-9343-b1e9271e1758 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:17:57 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:57 devstack sudo[93176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 1073741824 Sep 23 00:17:57 devstack sudo[93176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:57 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b" returned: 0 in 0.730s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:57 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b Sep 23 00:17:57 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-05efd5ce-cb12-4828-b089-06fbf692309f tempest-VolumesTransfersV357Test-1953507674 None] Transfer volume completed successfully. Sep 23 00:17:58 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239.f658e90e-ac43-41c6-9d13-2af67bea2b1b" returned: 0 in 0.420s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-quobyte-f658e90e-ac43-41c6-9d13-2af67bea2b1b" released by "_delete_snapshot" :: held 2.688s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-quobyte-b351c61b-b2f1-4c8a-9e7b-c33881dea239" released by "delete_snapshot" :: held 2.730s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Created reservations ['d3cf8d84-c8bb-4dfa-b5fc-b37247551d21', '7e50ff63-5c4f-4e9c-a878-4e3bd13424ed', '2089f98f-4f9f-47a3-b7a2-8af574477180', 'f2c7ea8a-ecbb-483f-99c6-c548a279d3fb', '0d517911-5c88-4224-8ef2-77811c17ce63'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:17:58 devstack sudo[93176]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 1073741824" returned: 0 in 0.855s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Delete snapshot completed successfully. Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa644834-9b37-4105-a799-2df8e66a81f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-f658e90e-ac43-41c6-9d13-2af67bea2b1b-delete_snapshot" released by "delete_snapshot" :: held 3.054s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:58 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 Sep 23 00:17:58 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:58 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758" returned: 0 in 0.337s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:17:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4548a3-5766-48e2-8f0e-edd362783a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d811ac-c212-4fe5-9343-b1e9271e1758', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624d2993-6b7b-46a8-b698-e73eea5b9ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:17:59 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Volume volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 (c6d811ac-c212-4fe5-9343-b1e9271e1758): created successfully Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624d2993-6b7b-46a8-b698-e73eea5b9ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Flow 'volume_create_manager' (23f473b8-9c82-41d5-bba0-943f496ef644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Acquiring lock "cinder-a90f3947-696b-4ee6-b978-95571e0fa021-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:59 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-39125fa8-5e40-4ad1-a4f0-9f0e2c46b379 tempest-ServersNegativeTestJSON-1477833591 None] Created volume successfully. Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Lock "cinder-a90f3947-696b-4ee6-b978-95571e0fa021-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Acquiring lock "cinder-quobyte-a90f3947-696b-4ee6-b978-95571e0fa021" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Lock "cinder-quobyte-a90f3947-696b-4ee6-b978-95571e0fa021" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[751ef3fb-d7c9-463d-8215-4cb221fefeb9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:59 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021 Sep 23 00:17:59 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Acquiring lock "cinder-b351c61b-b2f1-4c8a-9e7b-c33881dea239-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-b351c61b-b2f1-4c8a-9e7b-c33881dea239-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Acquiring lock "cinder-quobyte-b351c61b-b2f1-4c8a-9e7b-c33881dea239" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-quobyte-b351c61b-b2f1-4c8a-9e7b-c33881dea239" acquired by "delete_volume" :: waited 0.067s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70c6308-b334-4e7e-8b25-310d1008f3d2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:17:59 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 Sep 23 00:17:59 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:17:59 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021" returned: 0 in 0.746s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:17:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:00 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021 Sep 23 00:18:00 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "cinder-c6d811ac-c212-4fe5-9343-b1e9271e1758-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:00 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239" returned: 0 in 0.732s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Lock "cinder-c6d811ac-c212-4fe5-9343-b1e9271e1758-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:00 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239 Sep 23 00:18:00 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "cinder-quobyte-c6d811ac-c212-4fe5-9343-b1e9271e1758" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Lock "cinder-quobyte-c6d811ac-c212-4fe5-9343-b1e9271e1758" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:00 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a90f3947-696b-4ee6-b978-95571e0fa021" returned: 0 in 0.569s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cbdf39-7488-4cd0-b95f-c7e5dac1bfcf]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Lock "cinder-quobyte-a90f3947-696b-4ee6-b978-95571e0fa021" released by "delete_volume" :: held 1.403s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Created reservations ['c4277d2e-bddd-4041-ac86-2e33c29a36d8', '67bdd2f3-c64a-4651-b39f-c470fdca2b3b', 'e077a35c-e8b4-4ff3-98cf-2b25df3389ab', '4d814caf-809e-4831-9030-09fc6684cee7', '94a5b85a-ff0f-42bb-badc-2a1a8d1649f7'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:00 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 Sep 23 00:18:00 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:00 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b351c61b-b2f1-4c8a-9e7b-c33881dea239" returned: 0 in 0.368s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:00 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:00 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-quobyte-b351c61b-b2f1-4c8a-9e7b-c33881dea239" released by "delete_volume" :: held 1.207s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:00 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Created reservations ['fd291140-c48b-4616-9bd5-a901bfc2fd8b', 'e0022a86-649f-4864-92b1-42e5f5dbaecb', 'c1f73c0c-45ff-4c05-bd51-443f8b5b01c4', '266a1a77-e854-41b1-bde6-281d2017a4f0', 'd88a6a9d-5ae2-4aca-96a6-c4344e58230d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:01 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:01 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:01 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758" returned: 0 in 0.528s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:01 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.351s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Deleted volume successfully. Sep 23 00:18:01 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758 Sep 23 00:18:01 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9467b9eb-2858-4a5a-94fb-01835ed2ef38 tempest-VolumesTransfersV357Test-509360245 None] Lock "cinder-a90f3947-696b-4ee6-b978-95571e0fa021-delete_volume" released by "delete_volume" :: held 2.065s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:01 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.387s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:01 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Deleted volume successfully. Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c6d811ac-c212-4fe5-9343-b1e9271e1758" returned: 0 in 0.368s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Lock "cinder-quobyte-c6d811ac-c212-4fe5-9343-b1e9271e1758" released by "delete_volume" :: held 0.980s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-312f0543-31c6-45c4-a8a7-74de81216694 tempest-VolumeSnapshotQuotasNegativeTestJSON-446592472 None] Lock "cinder-b351c61b-b2f1-4c8a-9e7b-c33881dea239-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Created reservations ['db5eb2af-7257-4cb0-9d37-ad6dafd2d676', '7eeca869-2801-4136-801f-3216da052785', '3f7fc23c-6489-4c2d-a12e-ebf2aa0a2b30', '83c4c27c-3e7f-4c83-848b-fc7efffb1b8a', 'de96f6e3-2e17-408b-b33d-8a9fe5f40a2d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:01 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:01 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:02 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.653s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:02 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Deleted volume successfully. Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-657cbde5-ba1c-43d9-b21f-75bd15c4a6fe tempest-ServersNegativeTestJSON-1477833591 None] Lock "cinder-c6d811ac-c212-4fe5-9343-b1e9271e1758-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Flow 'volume_create_manager' (2744989d-ab2b-4f7d-a705-2b264d84440d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d0873a-0516-48cf-9531-f97f30bfa187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d0873a-0516-48cf-9531-f97f30bfa187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2062440848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbf5eab-98dc-440e-a1ca-393d25f3937d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f25e17c1e04449c893b6b51e0eaaa32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:02Z,use_quota=True,user_id='e5857a0c68a642cabaed2d3b3dcc5d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1071b5-4cb1-4f49-9f99-3020ec2b8aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1071b5-4cb1-4f49-9f99-3020ec2b8aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798764f4-687d-4b40-ac12-495bc887dc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798764f4-687d-4b40-ac12-495bc887dc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdbf5eab-98dc-440e-a1ca-393d25f3937d', 'volume_name': 'volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba27ad0-aaaf-4071-b590-554d47e41496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ba27ad0-aaaf-4071-b590-554d47e41496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49645bd-bc9d-43ed-a6c4-271e896797bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:02 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Volume bdbf5eab-98dc-440e-a1ca-393d25f3937d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d', 'volume_size': 1} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2062440848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdbf5eab-98dc-440e-a1ca-393d25f3937d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f25e17c1e04449c893b6b51e0eaaa32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:02Z,use_quota=True,user_id='e5857a0c68a642cabaed2d3b3dcc5d2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Creating volume bdbf5eab-98dc-440e-a1ca-393d25f3937d {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:02 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:02 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d 1073741824 Sep 23 00:18:02 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:02 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "cinder-31b2a8f7-3b5c-461d-b30c-b2fe66530512-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:03 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:03 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Lock "cinder-31b2a8f7-3b5c-461d-b30c-b2fe66530512-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "cinder-quobyte-31b2a8f7-3b5c-461d-b30c-b2fe66530512" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Lock "cinder-quobyte-31b2a8f7-3b5c-461d-b30c-b2fe66530512" acquired by "delete_volume" :: waited 0.073s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d484e7f-9e2d-4c6d-98a9-122aa48dd80c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:03 devstack sudo[93261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 Sep 23 00:18:03 devstack sudo[93261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:03 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.806s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:18:03 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d 1073741824" returned: 0 in 1.218s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:04 devstack sudo[93261]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512" returned: 0 in 0.714s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:04 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d Sep 23 00:18:04 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:04 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512 Sep 23 00:18:04 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:04 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d" returned: 0 in 0.418s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49645bd-bc9d-43ed-a6c4-271e896797bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09b7387-68fe-48e2-9ec2-447681306a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:04 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Volume volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d (bdbf5eab-98dc-440e-a1ca-393d25f3937d): created successfully Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09b7387-68fe-48e2-9ec2-447681306a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Flow 'volume_create_manager' (2744989d-ab2b-4f7d-a705-2b264d84440d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:04 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-100736a7-3f77-4933-879e-d4ecdb3a6d09 tempest-VolumesTransfersV357Test-1705485235 None] Created volume successfully. Sep 23 00:18:04 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-31b2a8f7-3b5c-461d-b30c-b2fe66530512" returned: 0 in 0.593s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Lock "cinder-quobyte-31b2a8f7-3b5c-461d-b30c-b2fe66530512" released by "delete_volume" :: held 1.468s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Created reservations ['80a12cde-5c60-4b80-91e1-1a4052d0778b', '0543e281-4883-4b8a-98fe-faa28d0b0e72', '65bffaef-f213-4f22-94d1-db1874d125b8', '9817a4af-318a-4bc0-8d72-f5c659849358', 'a34a2df8-f0e1-476d-95de-a6b2d12d7a3d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:04 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:04 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:05 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.436s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:05 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:05 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Deleted volume successfully. Sep 23 00:18:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b5ccef10-1767-41eb-b183-78582f4ae242 tempest-ServersNegativeTestJSON-1477833591 None] Lock "cinder-31b2a8f7-3b5c-461d-b30c-b2fe66530512-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Acquiring lock "cinder-bdbf5eab-98dc-440e-a1ca-393d25f3937d-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Lock "cinder-bdbf5eab-98dc-440e-a1ca-393d25f3937d-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Acquiring lock "cinder-quobyte-bdbf5eab-98dc-440e-a1ca-393d25f3937d" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Lock "cinder-quobyte-bdbf5eab-98dc-440e-a1ca-393d25f3937d" acquired by "delete_volume" :: waited 0.071s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-1d9d2f01-b048-4eab-a76d-339bf79c9612 tempest-ServerActionsTestOtherA-2073692176 None] Terminate volume connection completed successfully. Sep 23 00:18:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-1d9d2f01-b048-4eab-a76d-339bf79c9612 tempest-ServerActionsTestOtherA-2073692176 None] Deleting attachment 9494f103-9cdb-4ac7-9ab4-081d19b4de22. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:18:06 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed56dd-4e6e-496f-8df4-025dee78af03]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:06 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d Sep 23 00:18:06 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "cinder-1b408361-5cc6-48aa-9f76-ddd217eda2d4-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Lock "cinder-1b408361-5cc6-48aa-9f76-ddd217eda2d4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "cinder-quobyte-1b408361-5cc6-48aa-9f76-ddd217eda2d4" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Lock "cinder-quobyte-1b408361-5cc6-48aa-9f76-ddd217eda2d4" acquired by "delete_volume" :: waited 0.058s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:07 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca28f79-7bad-46e1-96e3-a7df84b1dbf7]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:07 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d" returned: 0 in 0.980s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:07 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 Sep 23 00:18:07 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:07 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d Sep 23 00:18:07 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:08 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bdbf5eab-98dc-440e-a1ca-393d25f3937d" returned: 0 in 0.704s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:08 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4" returned: 0 in 0.956s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Lock "cinder-quobyte-bdbf5eab-98dc-440e-a1ca-393d25f3937d" released by "delete_volume" :: held 1.813s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:08 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4 Sep 23 00:18:08 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Created reservations ['0cb4f3f2-88e1-4616-96c9-4afa6388a455', '519a20d5-6216-4d8a-9a1b-8c908af66098', '94ef3d5b-83f5-4e81-a676-d1b62f535bad', 'f3dcf8be-24f4-4267-801f-f5616b49b68d', 'bbf20f16-4832-46f3-a3bc-81c1dc7dd7a7'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:09 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:09 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:09 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1b408361-5cc6-48aa-9f76-ddd217eda2d4" returned: 0 in 0.799s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Lock "cinder-quobyte-1b408361-5cc6-48aa-9f76-ddd217eda2d4" released by "delete_volume" :: held 1.927s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "cinder-d923a01b-c105-4a75-84e3-ce709f9979d2-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG cinder.quota [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Created reservations ['48a446c2-44da-440b-92d9-fbc8d4f0b317', '985f731f-6e20-4eb3-8128-477cf234ac35', '93708bf0-74be-45ea-9c95-df2a6807f867', 'bc1f0642-6115-4776-9118-20bb9f7d0174', '64c52476-1a7c-4df9-989a-2d144a002507'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Lock "cinder-d923a01b-c105-4a75-84e3-ce709f9979d2-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "cinder-quobyte-d923a01b-c105-4a75-84e3-ce709f9979d2" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Lock "cinder-quobyte-d923a01b-c105-4a75-84e3-ce709f9979d2" acquired by "delete_volume" :: waited 0.079s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[514f32a1-5d68-4a5d-97a3-e844248f7e1e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:09 devstack sudo[93391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:10 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:10 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 1.098s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:10 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Deleted volume successfully. Sep 23 00:18:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4a7610cc-b914-4379-a1a0-9046c2b56d0f tempest-VolumesTransfersV357Test-509360245 None] Lock "cinder-bdbf5eab-98dc-440e-a1ca-393d25f3937d-delete_volume" released by "delete_volume" :: held 3.741s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:10 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2 Sep 23 00:18:10 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:10 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.614s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:10 devstack cinder-volume[87138]: DEBUG cinder.manager [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Deleted volume successfully. Sep 23 00:18:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-970b6d3b-462b-4d20-aa21-fd8bc112d308 req-59cdb532-c18a-485e-895e-bb0d1ffad6af tempest-ServerActionsTestOtherA-2073692176 None] Lock "cinder-1b408361-5cc6-48aa-9f76-ddd217eda2d4-delete_volume" released by "delete_volume" :: held 3.432s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:10 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2" returned: 0 in 0.905s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:10 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2 Sep 23 00:18:10 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:11 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d923a01b-c105-4a75-84e3-ce709f9979d2" returned: 0 in 0.450s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Lock "cinder-quobyte-d923a01b-c105-4a75-84e3-ce709f9979d2" released by "delete_volume" :: held 1.489s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Created reservations ['37cc8077-216b-4890-8f53-5db7289b0d08', 'a9da4f17-9f07-4a21-98ee-364a56859162', 'a44d194b-041a-48b6-8287-dbcd1816864e', '23f95fc2-c2b1-47aa-a68c-409a5cfb1c8c', '73f0af10-9fa8-4e5d-8b7f-afa9cb208f35'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:11 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:11 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:11 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.392s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:11 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:11 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Deleted volume successfully. Sep 23 00:18:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fbbd8fdc-940c-4ea9-8f76-302c48a45ec2 tempest-ServerActionsTestOtherA-2073692176 None] Lock "cinder-d923a01b-c105-4a75-84e3-ce709f9979d2-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:21 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=64,cinder:INSERT=23,cinder:UPDATE=87,cinder:DELETE=5 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:22 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=85,cinder:SELECT=63,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Flow 'volume_create_manager' (e97212ab-ec9d-45e1-b87d-6993fe9c2e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b5f479-4780-407f-b3a7-50a9bd528f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b5f479-4780-407f-b3a7-50a9bd528f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1993016787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19421575-f8ba-47b6-bf8a-a9b1fef9ef4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37816a22baf492d8a68eb9e5eb888ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:24Z,use_quota=True,user_id='ceb25db7f6844a27932265ceab15e21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f92c796-a054-4b74-9dc1-02b8314bcb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f92c796-a054-4b74-9dc1-02b8314bcb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07be1125-3a65-4420-9dac-009abbf43d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07be1125-3a65-4420-9dac-009abbf43d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19421575-f8ba-47b6-bf8a-a9b1fef9ef4e', 'volume_name': 'volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c7f905-26b8-4b4c-aa32-7dcc2e05a522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c7f905-26b8-4b4c-aa32-7dcc2e05a522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41aafbd4-4e45-4394-b4e3-9d55fffdcd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Volume 19421575-f8ba-47b6-bf8a-a9b1fef9ef4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e', 'volume_size': 1} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1993016787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19421575-f8ba-47b6-bf8a-a9b1fef9ef4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37816a22baf492d8a68eb9e5eb888ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:24Z,use_quota=True,user_id='ceb25db7f6844a27932265ceab15e21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Creating volume 19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:23 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:18:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:23 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e 1073741824 Sep 23 00:18:23 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:24 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e 1073741824" returned: 0 in 0.779s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:24 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e Sep 23 00:18:24 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:25 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e" returned: 0 in 0.347s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41aafbd4-4e45-4394-b4e3-9d55fffdcd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b69cd4c-940d-4d56-844a-714f20a3fd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Volume volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e (19421575-f8ba-47b6-bf8a-a9b1fef9ef4e): created successfully Sep 23 00:18:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b69cd4c-940d-4d56-844a-714f20a3fd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Flow 'volume_create_manager' (e97212ab-ec9d-45e1-b87d-6993fe9c2e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6e57b506-1603-4d8f-b7ee-567dd69d9541 tempest-VolumesCloneTest-411142826 None] Created volume successfully. Sep 23 00:18:26 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Flow 'volume_create_manager' (6cbf44ba-20b0-4a68-af68-fe14db692c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5b6005-845a-4c9e-8a61-8aee2fd8c77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5b6005-845a-4c9e-8a61-8aee2fd8c77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-930920277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea52e896-ca88-47a3-831e-5397ea2058dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c37816a22baf492d8a68eb9e5eb888ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=19421575-f8ba-47b6-bf8a-a9b1fef9ef4e,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:27Z,use_quota=True,user_id='ceb25db7f6844a27932265ceab15e21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df6d06f-8a8c-461e-98a4-fc5a9b1c27bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df6d06f-8a8c-461e-98a4-fc5a9b1c27bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caba80ed-ee64-45fd-b82b-00359065f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caba80ed-ee64-45fd-b82b-00359065f02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ea52e896-ca88-47a3-831e-5397ea2058dc', 'volume_name': 'volume-ea52e896-ca88-47a3-831e-5397ea2058dc', 'volume_size': 2, 'source_volid': '19421575-f8ba-47b6-bf8a-a9b1fef9ef4e', 'source_volstatus': 'available'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdc7149-aad0-4ecb-a045-c391935e1b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdc7149-aad0-4ecb-a045-c391935e1b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51fbba23-1087-4d36-9048-67d20ad1dbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:27 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Volume ea52e896-ca88-47a3-831e-5397ea2058dc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ea52e896-ca88-47a3-831e-5397ea2058dc', 'volume_size': 2, 'source_volid': '19421575-f8ba-47b6-bf8a-a9b1fef9ef4e', 'source_volstatus': 'available'} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:27 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Cloning volume 19421575-f8ba-47b6-bf8a-a9b1fef9ef4e to volume ea52e896-ca88-47a3-831e-5397ea2058dc Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Creating offline snapshot 82f2ecb1-7aad-4f90-aaad-e17578367449 of volume 19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd3c715-b6e9-412a-b25e-df706e798540]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:27 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e Sep 23 00:18:27 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:27 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e" returned: 0 in 0.723s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:28 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 1G Sep 23 00:18:28 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:28 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 1G" returned: 0 in 0.776s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:28 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 Sep 23 00:18:28 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:29 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449" returned: 0 in 0.469s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:29 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 is being set with open permissions: ugo+rw Sep 23 00:18:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:29 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 Sep 23 00:18:29 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:29 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449" returned: 0 in 0.411s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:29 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.info Sep 23 00:18:29 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:30 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.info" returned: 0 in 0.376s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:30 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.info is being set with open permissions: ugo+rw Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:30 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.info Sep 23 00:18:30 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:30 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.info" returned: 0 in 0.332s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Acquiring lock "cinder-quobyte-ea52e896-ca88-47a3-831e-5397ea2058dc" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Lock "cinder-quobyte-ea52e896-ca88-47a3-831e-5397ea2058dc" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] snapshot: 82f2ecb1-7aad-4f90-aaad-e17578367449, volume: ea52e896-ca88-47a3-831e-5397ea2058dc, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[978bfe90-263b-4264-ab74-bb496de579d9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:30 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 Sep 23 00:18:30 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:31 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449" returned: 0 in 0.677s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:31 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd26823-1463-4d27-96b7-95a477d9e6d0]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:31 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e Sep 23 00:18:31 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:31 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e" returned: 0 in 0.562s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:18:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:18:31 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:18:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:31 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc Sep 23 00:18:31 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:37 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:18:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Flow 'volume_create_manager' (f00e03a3-3cba-4106-bf68-bca8ec66aeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e5eb33-a4c5-47ac-a0ae-7f57dd168068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e5eb33-a4c5-47ac-a0ae-7f57dd168068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1403741877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529b5817-0ec4-4b0c-8bd5-ccaaa8eae958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efb1ee9c0d44896bb9db73acb051964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:37Z,use_quota=True,user_id='d10d34700f544e6fa7f82f8d5718b94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265ef98f-7e9b-44b8-b1db-938334e24d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (265ef98f-7e9b-44b8-b1db-938334e24d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe39cbf-4d84-475e-99a6-64137473e674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:37 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:18:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe39cbf-4d84-475e-99a6-64137473e674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '529b5817-0ec4-4b0c-8bd5-ccaaa8eae958', 'volume_name': 'volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0353d8c-c15a-4e0e-aef5-fb7c16393dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0353d8c-c15a-4e0e-aef5-fb7c16393dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937a5019-369a-4ba4-8050-479dd8a56beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:38 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Volume 529b5817-0ec4-4b0c-8bd5-ccaaa8eae958: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:18:38 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Trying to clone 529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:18:38 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:18:38 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:18:39 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a731caa-29db-4f34-85e7-2a4ea9cebcd4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:39 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD Sep 23 00:18:39 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:40 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD" returned: 0 in 0.918s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:40 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb is fetched for user d10d34700f544e6fa7f82f8d5718b94c. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:18:40 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb10368-6346-465f-9feb-7f3d3567e5ae]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:40 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD Sep 23 00:18:40 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:41 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD" returned: 0 in 1.174s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:42 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc" returned: 0 in 10.879s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:42 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e, size 1024.00 MB, duration 10.88 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:18:42 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Converted 1024.00 MB image at 94.11 MB/s Sep 23 00:18:42 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc is being set with open permissions: ugo+rw Sep 23 00:18:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:42 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc Sep 23 00:18:42 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:43 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc" returned: 0 in 0.342s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Lock "cinder-quobyte-ea52e896-ca88-47a3-831e-5397ea2058dc" released by "_copy_volume_from_snapshot" :: held 12.588s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Acquiring lock "cinder-quobyte-82f2ecb1-7aad-4f90-aaad-e17578367449" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Lock "cinder-quobyte-82f2ecb1-7aad-4f90-aaad-e17578367449" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Deleting offline snapshot 82f2ecb1-7aad-4f90-aaad-e17578367449 of volume 19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] snapshot_file for this snap is: volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c79be76-8798-484a-bbdd-446e4c52850b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:43 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 Sep 23 00:18:43 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:43 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449" returned: 0 in 0.433s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7f481d-94d6-4051-ac78-22db009ba9a3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:43 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e Sep 23 00:18:43 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:44 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e" returned: 0 in 0.813s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:44 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 Sep 23 00:18:44 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:45 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449" returned: 0 in 0.559s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:45 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449 Sep 23 00:18:45 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:45 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e.82f2ecb1-7aad-4f90-aaad-e17578367449" returned: 0 in 0.421s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Lock "cinder-quobyte-82f2ecb1-7aad-4f90-aaad-e17578367449" released by "_delete_snapshot" :: held 2.414s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.446s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.160s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1403741877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529b5817-0ec4-4b0c-8bd5-ccaaa8eae958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efb1ee9c0d44896bb9db73acb051964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:18:37Z,use_quota=True,user_id='d10d34700f544e6fa7f82f8d5718b94c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Creating volume 529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:18:45 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51fbba23-1087-4d36-9048-67d20ad1dbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea52e896-ca88-47a3-831e-5397ea2058dc', 'volume_size': 2, 'source_volid': '19421575-f8ba-47b6-bf8a-a9b1fef9ef4e', 'source_volstatus': 'available'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:45 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 1073741824 Sep 23 00:18:45 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f764ef7-2e05-44f9-9ee2-50fe99788965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Volume volume-ea52e896-ca88-47a3-831e-5397ea2058dc (ea52e896-ca88-47a3-831e-5397ea2058dc): created successfully Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f764ef7-2e05-44f9-9ee2-50fe99788965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Flow 'volume_create_manager' (6cbf44ba-20b0-4a68-af68-fe14db692c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:45 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2aa93a72-93c1-48ef-92f8-41ab8e790817 tempest-VolumesCloneTest-411142826 None] Created volume successfully. Sep 23 00:18:46 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 1073741824" returned: 0 in 0.735s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:46 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 Sep 23 00:18:46 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:46 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958" returned: 0 in 0.368s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:18:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:46 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Attempting download of 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume 529b5817-0ec4-4b0c-8bd5-ccaaa8eae958. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:18:46 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7624351-cffe-42fa-9c77-1dfeed1cb7c7]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_fiuet3xt {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Acquiring lock "cinder-ea52e896-ca88-47a3-831e-5397ea2058dc-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:47 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_fiuet3xt Sep 23 00:18:47 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Lock "cinder-ea52e896-ca88-47a3-831e-5397ea2058dc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Acquiring lock "cinder-quobyte-ea52e896-ca88-47a3-831e-5397ea2058dc" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Lock "cinder-quobyte-ea52e896-ca88-47a3-831e-5397ea2058dc" acquired by "delete_volume" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e282a7-07eb-4982-87a7-841c63bb30fe]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc Sep 23 00:18:47 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:47 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_fiuet3xt" returned: 0 in 0.719s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_fiuet3xt {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:47 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_fiuet3xt Sep 23 00:18:47 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc" returned: 0 in 0.668s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack sudo[93561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc Sep 23 00:18:48 devstack sudo[93561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_fiuet3xt" returned: 1 in 0.435s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_fiuet3xt' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[dceb382e-51ac-4c2e-a9ca-1ed288e53025]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD Sep 23 00:18:48 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack sudo[93561]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea52e896-ca88-47a3-831e-5397ea2058dc" returned: 0 in 0.454s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Lock "cinder-quobyte-ea52e896-ca88-47a3-831e-5397ea2058dc" released by "delete_volume" :: held 1.224s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Created reservations ['77bb835f-21dd-4031-9122-c0c9202afb1e', '3527e87d-fab9-4902-85e6-baa3e0a717b0', '694264c6-52b9-4e51-a479-8100e0d6f73b', 'a7ad272c-e499-425b-8da4-30941be27eb7', '606cf3de-be4d-47aa-918a-e3386b1ead14'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:48 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD" returned: 0 in 0.590s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb was qcow2, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 Sep 23 00:18:48 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:48 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:48 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:49 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.336s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:49 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Deleted volume successfully. Sep 23 00:18:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33b59a34-de33-4cad-a5d0-30ef16314a5e tempest-VolumesCloneTest-411142826 None] Lock "cinder-ea52e896-ca88-47a3-831e-5397ea2058dc-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Acquiring lock "cinder-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Lock "cinder-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Acquiring lock "cinder-quobyte-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Lock "cinder-quobyte-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:49 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d6e498-4a27-4e0b-a120-6063a227f271]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:50 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e Sep 23 00:18:50 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:50 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e" returned: 0 in 0.724s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:50 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e Sep 23 00:18:50 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:51 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e" returned: 0 in 0.593s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Lock "cinder-quobyte-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e" released by "delete_volume" :: held 1.428s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Created reservations ['0f4039cb-3e31-4f15-9f1b-c9b8e7fd8daf', 'd0400e8b-2b33-4519-afae-6bc3786ebd41', '220cafd0-86f1-45b0-a28c-3e9662058ee9', '823212a9-a0b8-412f-8837-3d6dc69362ff', 'd2b6259b-ed30-4bba-97f1-d93a360df238'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:51 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:51 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:51 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958" returned: 0 in 3.208s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_n1xi0lo3devstack@QuobyteHD, size 112.00 MB, duration 3.22 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:18:51 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Converted 112.00 MB image at 34.80 MB/s Sep 23 00:18:51 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.487s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:51 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:52 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Deleted volume successfully. Sep 23 00:18:52 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 1G Sep 23 00:18:52 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-13f1d376-deef-4971-9e6e-b8abc8b44803 tempest-VolumesCloneTest-411142826 None] Lock "cinder-19421575-f8ba-47b6-bf8a-a9b1fef9ef4e-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:52 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 1G" returned: 0 in 0.642s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Downloaded image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume 529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb for user d10d34700f544e6fa7f82f8d5718b94c is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Marking volume 529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Copying metadata from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb to 529b5817-0ec4-4b0c-8bd5-ccaaa8eae958. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Creating volume glance metadata for volume 529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 backed by image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937a5019-369a-4ba4-8050-479dd8a56beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0c484d-9c89-4287-aa59-4b9c01c21c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:18:52 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Volume volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 (529b5817-0ec4-4b0c-8bd5-ccaaa8eae958): created successfully Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0c484d-9c89-4287-aa59-4b9c01c21c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:18:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Flow 'volume_create_manager' (f00e03a3-3cba-4106-bf68-bca8ec66aeea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:18:52 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-51a49377-d242-44b8-a960-be33dc25a45e tempest-VolumesImageMetadata-2101825165 None] Created volume successfully. Sep 23 00:18:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Acquiring lock "cinder-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Lock "cinder-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Acquiring lock "cinder-quobyte-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:18:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Lock "cinder-quobyte-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958" acquired by "delete_volume" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:18:54 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dfe378-5274-4db5-b221-6f87f6d6f3e5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:18:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:55 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 Sep 23 00:18:55 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:55 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958" returned: 0 in 0.827s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:55 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958 Sep 23 00:18:55 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:56 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958" returned: 0 in 0.497s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Lock "cinder-quobyte-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958" released by "delete_volume" :: held 1.419s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Created reservations ['9a3b3b37-5674-4759-8ec6-e5ce6b9172bd', 'c5e02beb-8366-4cfa-a8f0-ce841ef38c47', 'e22e8225-7827-438b-aa45-82df7e71e04b', 'e293163b-dfc4-4e04-9db0-9d462a7b4b3c', '3ac1ef1e-4dc9-4f8b-90ac-1bbd0ebaf827'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:18:56 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:18:56 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:18:56 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.483s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:18:56 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:18:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Deleted volume successfully. Sep 23 00:18:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e033068f-dbf5-40c6-a6ff-9b3f00326795 tempest-VolumesImageMetadata-2101825165 None] Lock "cinder-529b5817-0ec4-4b0c-8bd5-ccaaa8eae958-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:00 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Flow 'volume_create_manager' (0fd076ff-9819-4ad3-b80e-2a31bfa61c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4216df-5e46-4227-a6c9-bd18449926ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4216df-5e46-4227-a6c9-bd18449926ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1948462293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5c5cdf-f43b-43c6-936b-e35af9438806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1620411a08e749e1b33a03f28d82df56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:01Z,use_quota=True,user_id='48ec3c0bbf9741cbb6609960a0404f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299ea680-9d15-4b44-a525-dc76b6224698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299ea680-9d15-4b44-a525-dc76b6224698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d0c0c7-122e-4c13-9856-751ef94c31b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:00 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:19:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d0c0c7-122e-4c13-9856-751ef94c31b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f5c5cdf-f43b-43c6-936b-e35af9438806', 'volume_name': 'volume-3f5c5cdf-f43b-43c6-936b-e35af9438806', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f229cf7-e0b2-43e8-8eeb-0e89a5579464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f229cf7-e0b2-43e8-8eeb-0e89a5579464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1037a90-ad8f-40b8-9320-f97ade851d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:01 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Volume 3f5c5cdf-f43b-43c6-936b-e35af9438806: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f5c5cdf-f43b-43c6-936b-e35af9438806', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:19:01 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Trying to clone 3f5c5cdf-f43b-43c6-936b-e35af9438806 from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:19:01 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:19:01 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[06543525-0482-4f04-b932-48e2461fa513]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:02 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD Sep 23 00:19:02 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:02 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:02 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb is fetched for user 48ec3c0bbf9741cbb6609960a0404f16. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:19:02 devstack sudo[93621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:19:02 devstack sudo[93621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[37821714-d577-4bae-bdfa-a8046b519051]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:03 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD Sep 23 00:19:03 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:03 devstack sudo[93621]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.556s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:19:03 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1948462293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f5c5cdf-f43b-43c6-936b-e35af9438806,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1620411a08e749e1b33a03f28d82df56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:01Z,use_quota=True,user_id='48ec3c0bbf9741cbb6609960a0404f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Creating volume 3f5c5cdf-f43b-43c6-936b-e35af9438806 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:03 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:19:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:03 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 1073741824 Sep 23 00:19:03 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:04 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 1073741824" returned: 0 in 0.978s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:04 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 Sep 23 00:19:04 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:05 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806" returned: 0 in 0.530s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:05 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Attempting download of 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume 3f5c5cdf-f43b-43c6-936b-e35af9438806. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:19:05 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8f8f09-2d56-48a1-a244-3380070f5a27]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_l7unp1gq {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:05 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_l7unp1gq Sep 23 00:19:05 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:06 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_l7unp1gq" returned: 0 in 0.724s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_l7unp1gq {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:06 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_l7unp1gq Sep 23 00:19:06 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Flow 'volume_create_manager' (92e47f3d-0993-4dfc-8a16-f64601204732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe66e0a2-4edd-45ab-8386-fc2a7b3b2e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe66e0a2-4edd-45ab-8386-fc2a7b3b2e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-655714165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9986e1-a866-4b09-8cce-adf0d1fa4b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229a3fd219544659568c4c16068e56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:06Z,use_quota=True,user_id='bdd16cc5bb7b4694830f9eb70e3a3934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f731c0-5aa9-4575-bb70-c47b955455f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f731c0-5aa9-4575-bb70-c47b955455f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff2c211-c150-4afa-a5f9-68846a00c218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff2c211-c150-4afa-a5f9-68846a00c218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9986e1-a866-4b09-8cce-adf0d1fa4b9e', 'volume_name': 'volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06abfcb2-7e78-42b8-ba7c-fdfef47d1dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06abfcb2-7e78-42b8-ba7c-fdfef47d1dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ca2423-ce1a-47e3-abff-47b488c97bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:06 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Volume 5f9986e1-a866-4b09-8cce-adf0d1fa4b9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e', 'volume_size': 1} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-655714165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9986e1-a866-4b09-8cce-adf0d1fa4b9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229a3fd219544659568c4c16068e56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:06Z,use_quota=True,user_id='bdd16cc5bb7b4694830f9eb70e3a3934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Creating volume 5f9986e1-a866-4b09-8cce-adf0d1fa4b9e {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:06 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:19:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:06 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e 1073741824 Sep 23 00:19:06 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:07 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_l7unp1gq" returned: 1 in 0.840s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_l7unp1gq' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:19:07 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9fc241-c195-4496-b680-939040efde8a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:07 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD Sep 23 00:19:07 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:08 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD" returned: 0 in 0.882s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb was qcow2, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:08 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e 1073741824" returned: 0 in 1.202s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:08 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 Sep 23 00:19:08 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:08 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e Sep 23 00:19:08 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:08 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" returned: 0 in 0.530s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ca2423-ce1a-47e3-abff-47b488c97bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c66121e-32a2-4dee-af1f-e959c42fcdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:08 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Volume volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e (5f9986e1-a866-4b09-8cce-adf0d1fa4b9e): created successfully Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c66121e-32a2-4dee-af1f-e959c42fcdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Flow 'volume_create_manager' (92e47f3d-0993-4dfc-8a16-f64601204732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f1f64400-600e-46ca-99b6-2b24f99ae8a3 tempest-SnapshotMetadataTestJSON-1140967200 None] Created volume successfully. Sep 23 00:19:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Creating offline snapshot 242d1e8e-23b8-46c4-a132-9eda509a88be of volume 5f9986e1-a866-4b09-8cce-adf0d1fa4b9e {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:10 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[857ca009-2e53-4042-a717-85b41faed199]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:10 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e Sep 23 00:19:10 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:11 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" returned: 0 in 0.767s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:11 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be 1G Sep 23 00:19:11 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:11 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806" returned: 0 in 3.736s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:11 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_b22of28gdevstack@QuobyteHD, size 112.00 MB, duration 3.74 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:19:11 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Converted 112.00 MB image at 29.96 MB/s Sep 23 00:19:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:11 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 1G Sep 23 00:19:11 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:12 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be 1G" returned: 0 in 0.921s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:12 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be Sep 23 00:19:12 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:12 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 1G" returned: 0 in 0.647s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Downloaded image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume 3f5c5cdf-f43b-43c6-936b-e35af9438806 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb for user 48ec3c0bbf9741cbb6609960a0404f16 is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Marking volume 3f5c5cdf-f43b-43c6-936b-e35af9438806 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Copying metadata from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb to 3f5c5cdf-f43b-43c6-936b-e35af9438806. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Creating volume glance metadata for volume 3f5c5cdf-f43b-43c6-936b-e35af9438806 backed by image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1037a90-ad8f-40b8-9320-f97ade851d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f5c5cdf-f43b-43c6-936b-e35af9438806', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6424488-b6f0-44dc-8e7e-ebb4db4e689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:12 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Volume volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 (3f5c5cdf-f43b-43c6-936b-e35af9438806): created successfully Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6424488-b6f0-44dc-8e7e-ebb4db4e689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Flow 'volume_create_manager' (0fd076ff-9819-4ad3-b80e-2a31bfa61c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:12 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c1191395-e2d7-4341-a699-494c4cfce55f tempest-VolumesExtendTest-197724139 None] Created volume successfully. Sep 23 00:19:13 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be" returned: 0 in 1.040s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:13 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be is being set with open permissions: ugo+rw Sep 23 00:19:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:13 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be Sep 23 00:19:13 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:13 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be" returned: 0 in 0.553s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:14 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.info Sep 23 00:19:14 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51b40807-560a-4960-ad6e-686a4b312612 tempest-VolumesExtendTest-197724139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:14 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.info" returned: 0 in 0.646s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:14 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.info is being set with open permissions: ugo+rw Sep 23 00:19:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:14 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.info Sep 23 00:19:14 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:15 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.info" returned: 0 in 0.563s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.926s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51b40807-560a-4960-ad6e-686a4b312612 tempest-VolumesExtendTest-197724139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.921s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:15 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb966f7e-7200-4b68-a937-47928dd9be78]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51b40807-560a-4960-ad6e-686a4b312612 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:15 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1be1f9fd-14d9-4065-9928-c8e6e5864432 tempest-SnapshotMetadataTestJSON-1140967200 None] Create snapshot completed successfully Sep 23 00:19:15 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 Sep 23 00:19:15 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:16 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51b40807-560a-4960-ad6e-686a4b312612 tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806" returned: 0 in 1.001s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51b40807-560a-4960-ad6e-686a4b312612 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 2G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51b40807-560a-4960-ad6e-686a4b312612 tempest-VolumesExtendTest-197724139 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 2G" returned: 0 in 0.296s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51b40807-560a-4960-ad6e-686a4b312612 tempest-VolumesExtendTest-197724139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.376s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:16 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-51b40807-560a-4960-ad6e-686a4b312612 tempest-VolumesExtendTest-197724139 None] Extend volume completed successfully. Sep 23 00:19:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Acquiring lock "cinder-242d1e8e-23b8-46c4-a132-9eda509a88be-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-242d1e8e-23b8-46c4-a132-9eda509a88be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Acquiring lock "cinder-quobyte-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-quobyte-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Acquiring lock "cinder-quobyte-242d1e8e-23b8-46c4-a132-9eda509a88be" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-quobyte-242d1e8e-23b8-46c4-a132-9eda509a88be" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Deleting offline snapshot 242d1e8e-23b8-46c4-a132-9eda509a88be of volume 5f9986e1-a866-4b09-8cce-adf0d1fa4b9e {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] snapshot_file for this snap is: volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:18 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93aeb45-8f8e-41a9-aba4-36731b719877]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:18 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be Sep 23 00:19:18 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Acquiring lock "cinder-3f5c5cdf-f43b-43c6-936b-e35af9438806-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Lock "cinder-3f5c5cdf-f43b-43c6-936b-e35af9438806-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Acquiring lock "cinder-quobyte-3f5c5cdf-f43b-43c6-936b-e35af9438806" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Lock "cinder-quobyte-3f5c5cdf-f43b-43c6-936b-e35af9438806" acquired by "delete_volume" :: waited 0.047s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[44323316-5248-4ed4-a908-347be56f8d13]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be" returned: 0 in 1.521s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0892847e-3b03-4e37-a7f2-d3a0d3745f56]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:19 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 Sep 23 00:19:19 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e Sep 23 00:19:20 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:20 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806" returned: 0 in 1.353s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:20 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806 Sep 23 00:19:20 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" returned: 0 in 1.325s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:21 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be Sep 23 00:19:21 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:21 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3f5c5cdf-f43b-43c6-936b-e35af9438806" returned: 0 in 0.861s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Lock "cinder-quobyte-3f5c5cdf-f43b-43c6-936b-e35af9438806" released by "delete_volume" :: held 2.304s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:21 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=52,cinder:SELECT=54,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:21 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Created reservations ['28354b5c-966d-4912-b9f3-b29d6ae5491a', '039730c2-1d06-47db-879c-326c85614896', '80718caf-7a67-4262-9f86-6b8ff81e27c5', '9bbad3c2-ebf3-4bd2-93cd-ae10b4a677af', '7d0b094e-4d7a-4d0a-82b8-48bfb12482db'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:22 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=58,cinder:INSERT=29,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:19:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:22 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:19:22 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:23 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be" returned: 0 in 2.076s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:23 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.854s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:23 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be Sep 23 00:19:23 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:23 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:23 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Deleted volume successfully. Sep 23 00:19:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f33f3d6-41b4-4c2e-899e-a333406d9f85 tempest-VolumesExtendTest-197724139 None] Lock "cinder-3f5c5cdf-f43b-43c6-936b-e35af9438806-delete_volume" released by "delete_volume" :: held 4.062s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:24 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e.242d1e8e-23b8-46c4-a132-9eda509a88be" returned: 0 in 1.045s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-quobyte-242d1e8e-23b8-46c4-a132-9eda509a88be" released by "_delete_snapshot" :: held 6.366s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-quobyte-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" released by "delete_snapshot" :: held 6.455s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Created reservations ['f8e11e4b-96f1-4cd9-861b-5c4a7e4e8296', '87f859f0-c8be-45f6-9a57-2271757c51e7', 'de8b0515-1150-4887-84f7-e99731ef075b', '94b1a12c-5098-4d54-a653-00e87ec9a3fa', '6c94adf9-63b9-40cc-8828-7bb48596db37'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Flow 'volume_create_manager' (f0e404c4-f2f3-462c-a1ff-ed71f14fa45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d58cf1-fc53-4d9a-8279-0f9a877001b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d58cf1-fc53-4d9a-8279-0f9a877001b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-869717640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8e6463-f1d1-4391-b6b3-5bea82a00527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1620411a08e749e1b33a03f28d82df56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:25Z,use_quota=True,user_id='48ec3c0bbf9741cbb6609960a0404f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e10223-9ef2-40c8-bdbc-e82bf7a0961c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e10223-9ef2-40c8-bdbc-e82bf7a0961c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f317141-580c-4307-a123-3c6350d4c83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f317141-580c-4307-a123-3c6350d4c83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8e6463-f1d1-4391-b6b3-5bea82a00527', 'volume_name': 'volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c0e9d2-90df-435a-ade7-e331f6a90743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c0e9d2-90df-435a-ade7-e331f6a90743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf45234b-853f-4904-be8f-354272637406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Volume ea8e6463-f1d1-4391-b6b3-5bea82a00527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527', 'volume_size': 1} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-869717640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8e6463-f1d1-4391-b6b3-5bea82a00527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1620411a08e749e1b33a03f28d82df56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:25Z,use_quota=True,user_id='48ec3c0bbf9741cbb6609960a0404f16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Creating volume ea8e6463-f1d1-4391-b6b3-5bea82a00527 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:24 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:19:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Delete snapshot completed successfully. Sep 23 00:19:25 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 1073741824 Sep 23 00:19:25 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ac25881-d401-4e58-804d-7f04aafe61c0 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-242d1e8e-23b8-46c4-a132-9eda509a88be-delete_snapshot" released by "delete_snapshot" :: held 7.197s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Acquiring lock "cinder-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Acquiring lock "cinder-quobyte-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-quobyte-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" acquired by "delete_volume" :: waited 0.059s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:25 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a227e61d-2899-4c59-9bcd-afd6592a168d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:25 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e Sep 23 00:19:25 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:26 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 1073741824" returned: 0 in 1.363s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:26 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 Sep 23 00:19:26 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:26 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" returned: 0 in 1.068s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:26 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e Sep 23 00:19:26 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:26 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527" returned: 0 in 0.461s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf45234b-853f-4904-be8f-354272637406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f7f84b-649e-4750-87ef-e4fcfb266e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:27 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Volume volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 (ea8e6463-f1d1-4391-b6b3-5bea82a00527): created successfully Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f7f84b-649e-4750-87ef-e4fcfb266e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Flow 'volume_create_manager' (f0e404c4-f2f3-462c-a1ff-ed71f14fa45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:27 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bcc4fbd0-b88f-4df3-bf36-1f6f56d881c1 tempest-VolumesExtendTest-197724139 None] Created volume successfully. Sep 23 00:19:27 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" returned: 0 in 0.482s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-quobyte-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e" released by "delete_volume" :: held 1.747s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Created reservations ['18d5abd0-aec1-4bd1-ab0f-4e9e4cc58542', '2ed04412-11b8-46f1-bd98-dd3aef92d82b', '0c44d218-a75b-4472-b52a-622bca741212', 'a46781c0-3344-47a7-8897-6ca82fd391eb', 'e60101d8-6af7-4feb-9af3-fef5451257f4'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:27 devstack sudo[93993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:19:27 devstack sudo[93993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:27 devstack sudo[93993]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.355s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:27 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Deleted volume successfully. Sep 23 00:19:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-53725844-1959-49e1-b3be-2899240c7fb5 tempest-SnapshotMetadataTestJSON-1140967200 None] Lock "cinder-5f9986e1-a866-4b09-8cce-adf0d1fa4b9e-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Creating offline snapshot e3b611c6-62ae-42d6-9527-dd6e5c33bf7d of volume ea8e6463-f1d1-4391-b6b3-5bea82a00527 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:19:28 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd1d295-8a31-4a00-ac64-d2664c12949e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:29 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 Sep 23 00:19:29 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527" returned: 0 in 0.837s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:29 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:29 devstack sudo[94007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d 1G Sep 23 00:19:29 devstack sudo[94007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:30 devstack sudo[94007]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d 1G" returned: 0 in 0.849s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:30 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d Sep 23 00:19:30 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:31 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d" returned: 0 in 0.894s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:31 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d is being set with open permissions: ugo+rw Sep 23 00:19:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:31 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d Sep 23 00:19:31 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:31 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d" returned: 0 in 0.336s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:31 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.info Sep 23 00:19:31 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:32 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.info" returned: 0 in 0.320s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:32 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.info is being set with open permissions: ugo+rw Sep 23 00:19:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:32 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.info Sep 23 00:19:32 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:32 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.info" returned: 0 in 0.281s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.745s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e6dfa7f3-0bd9-4fc9-aa25-7f215fc2feb3 tempest-VolumesExtendTest-197724139 None] Create snapshot completed successfully Sep 23 00:19:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a2885978-ee92-4b79-a5fc-0dc947f4cf64 tempest-VolumesExtendTest-197724139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a2885978-ee92-4b79-a5fc-0dc947f4cf64 tempest-VolumesExtendTest-197724139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:33 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c110403-4911-40c2-8a1e-811ecb751b53]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2885978-ee92-4b79-a5fc-0dc947f4cf64 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:33 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 Sep 23 00:19:33 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:34 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2885978-ee92-4b79-a5fc-0dc947f4cf64 tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527" returned: 0 in 0.700s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2885978-ee92-4b79-a5fc-0dc947f4cf64 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d 2G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2885978-ee92-4b79-a5fc-0dc947f4cf64 tempest-VolumesExtendTest-197724139 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d 2G" returned: 0 in 0.254s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a2885978-ee92-4b79-a5fc-0dc947f4cf64 tempest-VolumesExtendTest-197724139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.040s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:34 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a2885978-ee92-4b79-a5fc-0dc947f4cf64 tempest-VolumesExtendTest-197724139 None] Extend volume completed successfully. Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Flow 'volume_create_manager' (71dd8268-9c74-476d-8dba-bf506b2fca29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e68826-7c13-4b08-8706-5a94dca1bd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e68826-7c13-4b08-8706-5a94dca1bd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-862760462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fc7868-32b4-435c-970c-0ada8b56d568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645731d424fc4f5aa5c8688d81beea38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:35Z,use_quota=True,user_id='cfe9c875a2bf432aa7ddd01b95d2ab98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d1a0fe-6db9-4b03-b3b5-8411b70e7e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d1a0fe-6db9-4b03-b3b5-8411b70e7e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed3b895-34c1-422c-9847-a74e3c97152e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ed3b895-34c1-422c-9847-a74e3c97152e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9fc7868-32b4-435c-970c-0ada8b56d568', 'volume_name': 'volume-c9fc7868-32b4-435c-970c-0ada8b56d568', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1e44ba-52a1-443c-98da-ce04860c97e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1e44ba-52a1-443c-98da-ce04860c97e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dabf923-3a1d-42ec-9331-48dd2bb4bb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Volume c9fc7868-32b4-435c-970c-0ada8b56d568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9fc7868-32b4-435c-970c-0ada8b56d568', 'volume_size': 1} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-862760462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9fc7868-32b4-435c-970c-0ada8b56d568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='645731d424fc4f5aa5c8688d81beea38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:35Z,use_quota=True,user_id='cfe9c875a2bf432aa7ddd01b95d2ab98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Creating volume c9fc7868-32b4-435c-970c-0ada8b56d568 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:35 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568 1073741824 Sep 23 00:19:35 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:35 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568 1073741824" returned: 0 in 0.570s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Acquiring lock "cinder-e3b611c6-62ae-42d6-9527-dd6e5c33bf7d-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:36 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568 Sep 23 00:19:36 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-e3b611c6-62ae-42d6-9527-dd6e5c33bf7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Acquiring lock "cinder-quobyte-ea8e6463-f1d1-4391-b6b3-5bea82a00527" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-quobyte-ea8e6463-f1d1-4391-b6b3-5bea82a00527" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Acquiring lock "cinder-quobyte-e3b611c6-62ae-42d6-9527-dd6e5c33bf7d" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-quobyte-e3b611c6-62ae-42d6-9527-dd6e5c33bf7d" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Deleting offline snapshot e3b611c6-62ae-42d6-9527-dd6e5c33bf7d of volume ea8e6463-f1d1-4391-b6b3-5bea82a00527 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] snapshot_file for this snap is: volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ce251-1ded-40e7-94c6-2ae9adf902aa]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d Sep 23 00:19:36 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568" returned: 0 in 0.359s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dabf923-3a1d-42ec-9331-48dd2bb4bb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9fc7868-32b4-435c-970c-0ada8b56d568', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fbb804-26dd-4515-983d-5c1c5957c8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:36 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Volume volume-c9fc7868-32b4-435c-970c-0ada8b56d568 (c9fc7868-32b4-435c-970c-0ada8b56d568): created successfully Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93fbb804-26dd-4515-983d-5c1c5957c8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Flow 'volume_create_manager' (71dd8268-9c74-476d-8dba-bf506b2fca29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f3e8d895-1f76-4005-9697-fa883c8ffd5b tempest-VolumesMetadataTest-748343018 None] Created volume successfully. Sep 23 00:19:36 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d" returned: 0 in 0.487s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db661d4-d558-4b91-ab3a-c07f18be7539]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:36 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 Sep 23 00:19:36 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527" returned: 0 in 0.455s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d Sep 23 00:19:37 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:37 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d" returned: 0 in 0.538s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:37 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d Sep 23 00:19:37 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:38 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527.e3b611c6-62ae-42d6-9527-dd6e5c33bf7d" returned: 0 in 0.339s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-quobyte-e3b611c6-62ae-42d6-9527-dd6e5c33bf7d" released by "_delete_snapshot" :: held 2.020s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-quobyte-ea8e6463-f1d1-4391-b6b3-5bea82a00527" released by "delete_snapshot" :: held 2.081s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Created reservations ['04cb858a-f27f-4473-8773-c58b0e04f032', 'f8108260-d32b-4935-9a8c-3d45703e7e2a', 'c6bbbe72-0897-4bd8-9655-4828ebe08e1f', 'aa9ea27c-0933-410c-936e-b3d7c2b0db93', 'f81044d3-1aed-4517-b430-a60c18c06900'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:38 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Delete snapshot completed successfully. Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52a83c03-da8c-49ad-8e32-36fbbe60bec6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-e3b611c6-62ae-42d6-9527-dd6e5c33bf7d-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Acquiring lock "cinder-c9fc7868-32b4-435c-970c-0ada8b56d568-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Lock "cinder-c9fc7868-32b4-435c-970c-0ada8b56d568-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Acquiring lock "cinder-quobyte-c9fc7868-32b4-435c-970c-0ada8b56d568" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Lock "cinder-quobyte-c9fc7868-32b4-435c-970c-0ada8b56d568" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432bcbd-79cb-4d66-a58e-c36cad52f2f8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:38 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568 Sep 23 00:19:38 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568" returned: 0 in 0.480s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:39 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568 Sep 23 00:19:39 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Acquiring lock "cinder-ea8e6463-f1d1-4391-b6b3-5bea82a00527-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:39 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c9fc7868-32b4-435c-970c-0ada8b56d568" returned: 0 in 0.357s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-ea8e6463-f1d1-4391-b6b3-5bea82a00527-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Lock "cinder-quobyte-c9fc7868-32b4-435c-970c-0ada8b56d568" released by "delete_volume" :: held 0.915s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Acquiring lock "cinder-quobyte-ea8e6463-f1d1-4391-b6b3-5bea82a00527" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-quobyte-ea8e6463-f1d1-4391-b6b3-5bea82a00527" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0c078-f0b5-4eb0-b274-f443eb247a29]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Created reservations ['be3b62c1-039f-46e2-ab91-9659ff48c934', '17bcff6b-82e7-4afb-a2a8-73ff399575df', '7f64bb73-0864-47a5-9f68-edddc4e8b0af', '36cb3f83-8a66-4fcb-a345-aa2dd4b5c7a4', '33b04ddc-e683-4d99-b7b4-ae60931d78bb'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:39 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 Sep 23 00:19:39 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:39 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:19:39 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.310s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:40 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527" returned: 0 in 0.490s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Deleted volume successfully. Sep 23 00:19:40 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527 Sep 23 00:19:40 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b950c533-6aa3-427b-8826-e0f4b064d650 tempest-VolumesMetadataTest-748343018 None] Lock "cinder-c9fc7868-32b4-435c-970c-0ada8b56d568-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:40 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ea8e6463-f1d1-4391-b6b3-5bea82a00527" returned: 0 in 0.289s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-quobyte-ea8e6463-f1d1-4391-b6b3-5bea82a00527" released by "delete_volume" :: held 0.887s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Created reservations ['ed975af4-a8fc-4d51-8fa3-7562b318055e', '5008c0d3-efa0-4413-8a5c-a18d45b6569c', 'b9cd3d1f-b156-4383-9bd0-721e0e3af41f', '7815d91f-c823-4e74-9e1d-6ec19b3a759c', '3536f109-51b9-466e-9368-7708bf79d0c3'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:40 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:19:40 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:40 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.288s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Deleted volume successfully. Sep 23 00:19:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee5edf4a-a9b9-4114-ad6d-c2e567e022a6 tempest-VolumesExtendTest-197724139 None] Lock "cinder-ea8e6463-f1d1-4391-b6b3-5bea82a00527-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:44 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Flow 'volume_create_manager' (e8a352ad-dc36-4855-993e-f509e9d5c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116102fe-a6b7-46fa-8579-8bce3bf5a426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116102fe-a6b7-46fa-8579-8bce3bf5a426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1460378158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4b85c9-a3d9-42b8-8eec-3b236b1d5865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24b61409e8e4c37a4151b3f8af5dd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:45Z,use_quota=True,user_id='0c76dc3f47a942acb0eaaf9a50cdb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec81d891-f426-42d8-ba49-3a94feb675ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec81d891-f426-42d8-ba49-3a94feb675ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b8f5c9-4698-4565-936e-637792ece652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b8f5c9-4698-4565-936e-637792ece652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4b85c9-a3d9-42b8-8eec-3b236b1d5865', 'volume_name': 'volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf2d05c-a3aa-4bc0-89d7-1284aa80f651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf2d05c-a3aa-4bc0-89d7-1284aa80f651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1395049-23c1-49cd-93f4-cf95287be246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Volume 0c4b85c9-a3d9-42b8-8eec-3b236b1d5865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865', 'volume_size': 1} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1460378158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4b85c9-a3d9-42b8-8eec-3b236b1d5865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24b61409e8e4c37a4151b3f8af5dd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:45Z,use_quota=True,user_id='0c76dc3f47a942acb0eaaf9a50cdb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Creating volume 0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:45 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 1073741824 Sep 23 00:19:45 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:45 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 1073741824" returned: 0 in 0.730s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:45 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 Sep 23 00:19:45 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:46 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865" returned: 0 in 0.434s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1395049-23c1-49cd-93f4-cf95287be246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ef31e3-af77-4a32-a97a-77e7d52db042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:46 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Volume volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 (0c4b85c9-a3d9-42b8-8eec-3b236b1d5865): created successfully Sep 23 00:19:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ef31e3-af77-4a32-a97a-77e7d52db042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Flow 'volume_create_manager' (e8a352ad-dc36-4855-993e-f509e9d5c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0aa14542-89a3-460a-b0f7-df5d2d51f792 tempest-AttachVolumeTestJSON-1546700317 None] Created volume successfully. Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Flow 'volume_create_manager' (f3a094ba-a156-4f64-ac2e-d1c435d9d962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06115b6-c202-44c7-99cd-303b104b79cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a06115b6-c202-44c7-99cd-303b104b79cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1612794929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be00622-a27a-4311-9e06-a293aac97abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d97d8f84b8f472398a2b3d019f945b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:48Z,use_quota=True,user_id='dca06f24283847fab162ed81eca9f676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3de8866-5efe-4155-88b2-4a06a014cdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3de8866-5efe-4155-88b2-4a06a014cdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff37b71-4e91-4192-8e8c-b36af0eb77bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff37b71-4e91-4192-8e8c-b36af0eb77bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be00622-a27a-4311-9e06-a293aac97abe', 'volume_name': 'volume-7be00622-a27a-4311-9e06-a293aac97abe', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d201cfcc-281b-46c2-83c9-ff1e816f0274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d201cfcc-281b-46c2-83c9-ff1e816f0274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db91fbcb-53c3-4eef-b394-eb40e6685dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:48 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Volume 7be00622-a27a-4311-9e06-a293aac97abe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be00622-a27a-4311-9e06-a293aac97abe', 'volume_size': 1} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1612794929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be00622-a27a-4311-9e06-a293aac97abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d97d8f84b8f472398a2b3d019f945b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:48Z,use_quota=True,user_id='dca06f24283847fab162ed81eca9f676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Creating volume 7be00622-a27a-4311-9e06-a293aac97abe {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:48 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-43ca8dd9-30e2-4fd0-8430-85792eb0eea2 req-fc6f6579-3471-4b38-a0ff-6096ebc1f062 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:48 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe 1073741824 Sep 23 00:19:48 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:49 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe 1073741824" returned: 0 in 0.614s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:49 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe Sep 23 00:19:49 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:49 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe" returned: 0 in 0.412s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-43ca8dd9-30e2-4fd0-8430-85792eb0eea2 req-fc6f6579-3471-4b38-a0ff-6096ebc1f062 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.059s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db91fbcb-53c3-4eef-b394-eb40e6685dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be00622-a27a-4311-9e06-a293aac97abe', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923e1f9a-181b-46bb-a1f0-dfee8f038ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Flow 'volume_create_manager' (0369b97c-bc03-4a46-8da7-a74a2d56c403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37eb116-5539-4436-8a29-9f33a1751c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:49 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Volume volume-7be00622-a27a-4311-9e06-a293aac97abe (7be00622-a27a-4311-9e06-a293aac97abe): created successfully Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923e1f9a-181b-46bb-a1f0-dfee8f038ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Flow 'volume_create_manager' (f3a094ba-a156-4f64-ac2e-d1c435d9d962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37eb116-5539-4436-8a29-9f33a1751c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-555601370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afdc078-d8e5-4e82-a210-c8d64d608636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7690cbb5a26a40009b1d60c341be7a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:50Z,use_quota=True,user_id='5ef6ee765afe437aa7bdb9870f572467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4038642-2fd6-4ccc-8e1d-6ec32c7c45cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4038642-2fd6-4ccc-8e1d-6ec32c7c45cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8e594d-6e22-43c5-b33e-f18b670d503c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8e594d-6e22-43c5-b33e-f18b670d503c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afdc078-d8e5-4e82-a210-c8d64d608636', 'volume_name': 'volume-1afdc078-d8e5-4e82-a210-c8d64d608636', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6e6485-f95b-4a36-9922-2222dd0ca4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6e6485-f95b-4a36-9922-2222dd0ca4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606d488f-509d-45b4-b674-4db934fcece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:49 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Volume 1afdc078-d8e5-4e82-a210-c8d64d608636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afdc078-d8e5-4e82-a210-c8d64d608636', 'volume_size': 1} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-43ca8dd9-30e2-4fd0-8430-85792eb0eea2 req-fc6f6579-3471-4b38-a0ff-6096ebc1f062 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.228s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-555601370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afdc078-d8e5-4e82-a210-c8d64d608636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7690cbb5a26a40009b1d60c341be7a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:50Z,use_quota=True,user_id='5ef6ee765afe437aa7bdb9870f572467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Creating volume 1afdc078-d8e5-4e82-a210-c8d64d608636 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:49 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:19:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fd84313c-67ce-49a6-b583-5e2a9d3099c7 tempest-VolumesTransfersTest-1116414984 None] Created volume successfully. Sep 23 00:19:50 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636 1073741824 Sep 23 00:19:50 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-43ca8dd9-30e2-4fd0-8430-85792eb0eea2 req-fc6f6579-3471-4b38-a0ff-6096ebc1f062 tempest-AttachVolumeTestJSON-1546700317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '522f9557-29b4-49b3-90a1-1ea5aa850d91', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:19:50 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-43ca8dd9-30e2-4fd0-8430-85792eb0eea2 req-fc6f6579-3471-4b38-a0ff-6096ebc1f062 tempest-AttachVolumeTestJSON-1546700317 None] attachment_update completed successfully. Sep 23 00:19:50 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636 1073741824" returned: 0 in 0.734s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:50 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636 Sep 23 00:19:50 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:51 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636" returned: 0 in 0.482s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606d488f-509d-45b4-b674-4db934fcece0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afdc078-d8e5-4e82-a210-c8d64d608636', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac40864c-d15d-493c-b8dc-32bdeb6d9bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:51 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Volume volume-1afdc078-d8e5-4e82-a210-c8d64d608636 (1afdc078-d8e5-4e82-a210-c8d64d608636): created successfully Sep 23 00:19:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac40864c-d15d-493c-b8dc-32bdeb6d9bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Flow 'volume_create_manager' (0369b97c-bc03-4a46-8da7-a74a2d56c403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8f1276aa-5b07-4d8b-b11b-c2796aa8cebb tempest-AttachVolumeShelveTestJSON-864427319 None] Created volume successfully. Sep 23 00:19:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-341f5b4b-22ad-46d8-bdce-a6a19e25c0ae tempest-VolumesTransfersTest-2096064511 None] Transfer volume completed successfully. Sep 23 00:19:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Acquiring lock "cinder-7be00622-a27a-4311-9e06-a293aac97abe-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Lock "cinder-7be00622-a27a-4311-9e06-a293aac97abe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Acquiring lock "cinder-quobyte-7be00622-a27a-4311-9e06-a293aac97abe" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Lock "cinder-quobyte-7be00622-a27a-4311-9e06-a293aac97abe" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:53 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b607e3-8169-4e30-88d4-565076d5cdc9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:53 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe Sep 23 00:19:53 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:53 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe" returned: 0 in 0.677s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:53 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe Sep 23 00:19:53 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:54 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7be00622-a27a-4311-9e06-a293aac97abe" returned: 0 in 0.458s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Lock "cinder-quobyte-7be00622-a27a-4311-9e06-a293aac97abe" released by "delete_volume" :: held 1.204s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Created reservations ['6994ef6a-631c-45e7-889e-b9814b852215', '0a13f0af-cdbf-4202-9d9a-279e3b0f75a7', '49b044c9-087a-4d4e-95cd-4c6c9742200a', 'e30304ac-63bd-4524-ac33-4125ca6cd0a8', '6bdddd30-f249-422c-9890-46d8d245f529'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:54 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:19:54 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:54 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.395s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:55 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:19:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Deleted volume successfully. Sep 23 00:19:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-435a5c55-dabc-4721-a69f-f1d6102d0416 tempest-VolumesTransfersTest-1134622766 None] Lock "cinder-7be00622-a27a-4311-9e06-a293aac97abe-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Flow 'volume_create_manager' (ffae1b1e-c07d-4af0-a2fa-c16202cd5486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d889856-5fbb-4a64-a749-9b9b095f54fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d889856-5fbb-4a64-a749-9b9b095f54fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1617047092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502d01ef-569a-42b2-bbcd-1cc6da94d7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d97d8f84b8f472398a2b3d019f945b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:56Z,use_quota=True,user_id='dca06f24283847fab162ed81eca9f676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3883feeb-c9e4-45ff-97a3-3abc6edb86f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3883feeb-c9e4-45ff-97a3-3abc6edb86f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ff5b7e-1f67-4d0a-8a86-adea961435f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ff5b7e-1f67-4d0a-8a86-adea961435f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502d01ef-569a-42b2-bbcd-1cc6da94d7cf', 'volume_name': 'volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381a0b66-d286-4842-a2ad-627fc840c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381a0b66-d286-4842-a2ad-627fc840c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b3e874-abf2-4ee7-a883-f00bd37ce4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:56 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Volume 502d01ef-569a-42b2-bbcd-1cc6da94d7cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf', 'volume_size': 1} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1617047092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502d01ef-569a-42b2-bbcd-1cc6da94d7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d97d8f84b8f472398a2b3d019f945b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:19:56Z,use_quota=True,user_id='dca06f24283847fab162ed81eca9f676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Creating volume 502d01ef-569a-42b2-bbcd-1cc6da94d7cf {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:19:56 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:19:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:56 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf 1073741824 Sep 23 00:19:56 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:57 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf 1073741824" returned: 0 in 0.904s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:19:57 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf Sep 23 00:19:57 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:19:57 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Sep 23 00:19:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf" returned: 0 in 0.435s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:19:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:19:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:19:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b3e874-abf2-4ee7-a883-f00bd37ce4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40214618-0f26-4ffd-98b0-73ebf9343456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:19:58 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Volume volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf (502d01ef-569a-42b2-bbcd-1cc6da94d7cf): created successfully Sep 23 00:19:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40214618-0f26-4ffd-98b0-73ebf9343456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:19:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Flow 'volume_create_manager' (ffae1b1e-c07d-4af0-a2fa-c16202cd5486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:19:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-63cf91e8-f32f-45d4-978d-df55a3865d38 tempest-VolumesTransfersTest-1116414984 None] Created volume successfully. Sep 23 00:19:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Acquiring lock "cinder-502d01ef-569a-42b2-bbcd-1cc6da94d7cf-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Lock "cinder-502d01ef-569a-42b2-bbcd-1cc6da94d7cf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Acquiring lock "cinder-quobyte-502d01ef-569a-42b2-bbcd-1cc6da94d7cf" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:19:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Lock "cinder-quobyte-502d01ef-569a-42b2-bbcd-1cc6da94d7cf" acquired by "delete_volume" :: waited 0.053s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:19:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9312ad1c-2ebc-4224-a06b-6c006fe663f4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:19:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:00 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf Sep 23 00:20:00 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:00 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf" returned: 0 in 0.749s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:00 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf Sep 23 00:20:00 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:01 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-502d01ef-569a-42b2-bbcd-1cc6da94d7cf" returned: 0 in 0.792s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Lock "cinder-quobyte-502d01ef-569a-42b2-bbcd-1cc6da94d7cf" released by "delete_volume" :: held 1.703s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:01 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Created reservations ['3ac5dff5-d8b6-4040-91b5-faaef8fc5692', '4f8f7b91-9ed1-43a0-9c23-8ddd42589250', '4a03995a-72f4-4ad3-8cbe-7b35382f0d23', '403acd2b-db6a-4414-90de-9126c3fa8bb1', 'c999c302-cd13-43cc-b8fe-e8bfb77e88af'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:02 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:20:02 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:02 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:20:02 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:03 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 1.063s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:03 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Deleted volume successfully. Sep 23 00:20:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-65871589-e051-454a-ac10-3a6da78d9996 tempest-VolumesTransfersTest-1134622766 None] Lock "cinder-502d01ef-569a-42b2-bbcd-1cc6da94d7cf-delete_volume" released by "delete_volume" :: held 3.557s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:03 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.461s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:20:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:20:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (bdb1eb75-e5df-4571-afb5-03291f0fbc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f6516e-2e7c-45b3-af79-46d84af22dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f6516e-2e7c-45b3-af79-46d84af22dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1424227628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418b3487-cca6-4471-be07-5fccb433b1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad64cca3f9d47fdabec79d83185f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:08Z,use_quota=True,user_id='d00399fc513f455fafe449e016f1b8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc16b7e9-4b93-42c5-b506-f70443f2f58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc16b7e9-4b93-42c5-b506-f70443f2f58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1c8ada-8076-484b-bcb9-6dd74d440b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1c8ada-8076-484b-bcb9-6dd74d440b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '418b3487-cca6-4471-be07-5fccb433b1cf', 'volume_name': 'volume-418b3487-cca6-4471-be07-5fccb433b1cf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7366035-49e1-4cb6-8895-39ce03c3d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7366035-49e1-4cb6-8895-39ce03c3d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42488f58-4dd4-4c41-8d8b-b222e41a8daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:08 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Volume 418b3487-cca6-4471-be07-5fccb433b1cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-418b3487-cca6-4471-be07-5fccb433b1cf', 'volume_size': 1} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1424227628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=418b3487-cca6-4471-be07-5fccb433b1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad64cca3f9d47fdabec79d83185f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:08Z,use_quota=True,user_id='d00399fc513f455fafe449e016f1b8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Creating volume 418b3487-cca6-4471-be07-5fccb433b1cf {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:08 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:20:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:08 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf 1073741824 Sep 23 00:20:08 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf 1073741824" returned: 0 in 1.256s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:10 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf Sep 23 00:20:10 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:10 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf" returned: 0 in 0.455s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42488f58-4dd4-4c41-8d8b-b222e41a8daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-418b3487-cca6-4471-be07-5fccb433b1cf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a57c3a-4229-471a-a8ca-fbf2669bf651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:10 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Volume volume-418b3487-cca6-4471-be07-5fccb433b1cf (418b3487-cca6-4471-be07-5fccb433b1cf): created successfully Sep 23 00:20:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a57c3a-4229-471a-a8ca-fbf2669bf651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (bdb1eb75-e5df-4571-afb5-03291f0fbc1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e5f5ce59-0905-402d-98b8-fea9f054a1aa tempest-VolumesSnapshotTestJSON-726412997 None] Created volume successfully. Sep 23 00:20:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Creating offline snapshot 49d61c4e-544d-4e44-b1d3-91447db1f227 of volume 418b3487-cca6-4471-be07-5fccb433b1cf {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:20:13 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0695eb7-e603-41f5-b4d9-8b776fcf0e3b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:13 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf Sep 23 00:20:13 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-c015262d-2cbd-4499-9898-8b4b52feb652 req-95c34ab2-0965-4370-a158-5c7df3ad7bb2 tempest-AttachVolumeShelveTestJSON-864427319 None] No connector for attachment 6caed8e9-5abd-4099-90b6-3daf59a86178; skipping storage backend terminate_connection call. {{(pid=87138) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 23 00:20:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-c015262d-2cbd-4499-9898-8b4b52feb652 req-95c34ab2-0965-4370-a158-5c7df3ad7bb2 tempest-AttachVolumeShelveTestJSON-864427319 None] Deleting attachment 6caed8e9-5abd-4099-90b6-3daf59a86178. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:20:14 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf" returned: 0 in 0.600s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:14 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 1G Sep 23 00:20:14 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:15 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 1G" returned: 0 in 0.829s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-418b3487-cca6-4471-be07-5fccb433b1cf -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:15 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-418b3487-cca6-4471-be07-5fccb433b1cf -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 Sep 23 00:20:15 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:15 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-418b3487-cca6-4471-be07-5fccb433b1cf -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227" returned: 0 in 0.653s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:15 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 is being set with open permissions: ugo+rw Sep 23 00:20:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:15 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 Sep 23 00:20:15 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:16 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227" returned: 0 in 0.367s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:16 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.info Sep 23 00:20:16 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:16 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.info" returned: 0 in 0.747s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:16 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.info is being set with open permissions: ugo+rw Sep 23 00:20:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:17 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.info Sep 23 00:20:17 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:17 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.info" returned: 0 in 0.559s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.978s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-86ebf906-be75-4c90-b9c3-f8468269b825 tempest-VolumesSnapshotTestJSON-726412997 None] Create snapshot completed successfully Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-49d61c4e-544d-4e44-b1d3-91447db1f227-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-49d61c4e-544d-4e44-b1d3-91447db1f227-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-418b3487-cca6-4471-be07-5fccb433b1cf" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-418b3487-cca6-4471-be07-5fccb433b1cf" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-49d61c4e-544d-4e44-b1d3-91447db1f227" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-49d61c4e-544d-4e44-b1d3-91447db1f227" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Deleting offline snapshot 49d61c4e-544d-4e44-b1d3-91447db1f227 of volume 418b3487-cca6-4471-be07-5fccb433b1cf {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] snapshot_file for this snap is: volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a8dda-ee63-42f2-b9fb-57b1d6a64d36]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:19 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 Sep 23 00:20:19 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:20 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227" returned: 0 in 0.672s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-418b3487-cca6-4471-be07-5fccb433b1cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd532b71-58f9-4463-b7cb-55c0cf975626]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:20 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf Sep 23 00:20:20 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:20 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf" returned: 0 in 0.624s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:20 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 Sep 23 00:20:20 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Flow 'volume_create_manager' (34b25dd1-edac-4fed-950d-b3b80b5734db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa624b0-7baa-4a69-b429-eb619194993f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa624b0-7baa-4a69-b429-eb619194993f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1977234359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a44fb1-0a34-4653-9984-98936c5eacc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b359d35ee7824c7198b4c3390ef20590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:21Z,use_quota=True,user_id='a697a4bdb6b0430881f8dd8b50468926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6de5586-6343-49d9-a986-fef15718cc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6de5586-6343-49d9-a986-fef15718cc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a21ee3-46b8-4621-ae88-e2cd62db1f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a21ee3-46b8-4621-ae88-e2cd62db1f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a44fb1-0a34-4653-9984-98936c5eacc4', 'volume_name': 'volume-c8a44fb1-0a34-4653-9984-98936c5eacc4', 'volume_size': 2}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abfb7951-fc44-4bb1-8376-441b2ebb077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abfb7951-fc44-4bb1-8376-441b2ebb077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeab4eba-ff32-4a82-b4f6-235899e174c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:21 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Volume c8a44fb1-0a34-4653-9984-98936c5eacc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a44fb1-0a34-4653-9984-98936c5eacc4', 'volume_size': 2} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1977234359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a44fb1-0a34-4653-9984-98936c5eacc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b359d35ee7824c7198b4c3390ef20590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:21Z,use_quota=True,user_id='a697a4bdb6b0430881f8dd8b50468926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Creating volume c8a44fb1-0a34-4653-9984-98936c5eacc4 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:21 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 2147483648 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:21 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 2147483648 Sep 23 00:20:21 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:21 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227" returned: 0 in 0.470s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:21 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227 Sep 23 00:20:21 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:21 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf.49d61c4e-544d-4e44-b1d3-91447db1f227" returned: 0 in 0.350s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-49d61c4e-544d-4e44-b1d3-91447db1f227" released by "_delete_snapshot" :: held 2.387s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-418b3487-cca6-4471-be07-5fccb433b1cf" released by "delete_snapshot" :: held 2.430s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Created reservations ['755086d2-a3c1-4794-b767-d169b41f1933', '80d5ec88-3bfd-4354-a8f8-810a9d688118', '0ca15293-f98f-466e-a25d-f12b6d751185', '9767bf4b-1f58-4ff6-9dd2-58680bcc7582', '320a646e-9ec5-46b0-9237-ff3fed20074c'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:INSERT=30,cinder:UPDATE=95,cinder:SELECT=88,cinder:DELETE=9 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:21 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 2147483648" returned: 0 in 0.878s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Delete snapshot completed successfully. Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-04f6c339-0156-492a-9755-9e53120b1e32 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-49d61c4e-544d-4e44-b1d3-91447db1f227-delete_snapshot" released by "delete_snapshot" :: held 2.861s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:22 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 Sep 23 00:20:22 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:22 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4" returned: 0 in 0.611s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=111,cinder:DELETE=6,cinder:SELECT=93,cinder:INSERT=23 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeab4eba-ff32-4a82-b4f6-235899e174c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a44fb1-0a34-4653-9984-98936c5eacc4', 'volume_size': 2}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dcd03e-9b6d-43c0-afbc-c73f486d32e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:22 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Volume volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 (c8a44fb1-0a34-4653-9984-98936c5eacc4): created successfully Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37dcd03e-9b6d-43c0-afbc-c73f486d32e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Flow 'volume_create_manager' (34b25dd1-edac-4fed-950d-b3b80b5734db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-02da5a32-ba21-4920-94e7-c5320f4f7219 tempest-VolumesCloneNegativeTest-642541189 None] Created volume successfully. Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Acquiring lock "cinder-c8a44fb1-0a34-4653-9984-98936c5eacc4-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Lock "cinder-c8a44fb1-0a34-4653-9984-98936c5eacc4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Acquiring lock "cinder-quobyte-c8a44fb1-0a34-4653-9984-98936c5eacc4" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Lock "cinder-quobyte-c8a44fb1-0a34-4653-9984-98936c5eacc4" acquired by "delete_volume" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[cceef181-1d39-4013-bac4-c13f63f3594f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (dbdb9f70-0dcb-4c9b-92da-a8976adf604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc37d166-1de6-4431-8f02-f085f867abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc37d166-1de6-4431-8f02-f085f867abbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1475671365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb42aa23-7562-4082-9907-42950cf85a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad64cca3f9d47fdabec79d83185f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:24Z,use_quota=True,user_id='d00399fc513f455fafe449e016f1b8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf65abf4-64c1-42ee-ac61-2061740d7dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf65abf4-64c1-42ee-ac61-2061740d7dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897aa3e0-8c23-4ff0-a884-584f3885a86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897aa3e0-8c23-4ff0-a884-584f3885a86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb42aa23-7562-4082-9907-42950cf85a14', 'volume_name': 'volume-cb42aa23-7562-4082-9907-42950cf85a14', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999dc64a-62de-4c6f-be74-06bab650f21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999dc64a-62de-4c6f-be74-06bab650f21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010730ef-3435-4e1d-9509-4ee1798c2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Volume cb42aa23-7562-4082-9907-42950cf85a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb42aa23-7562-4082-9907-42950cf85a14', 'volume_size': 1} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1475671365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb42aa23-7562-4082-9907-42950cf85a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad64cca3f9d47fdabec79d83185f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:24Z,use_quota=True,user_id='d00399fc513f455fafe449e016f1b8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Creating volume cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:23 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:20:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:23 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 1073741824 Sep 23 00:20:23 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:23 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 Sep 23 00:20:23 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:24 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4" returned: 0 in 0.601s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:24 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4 Sep 23 00:20:24 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:24 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 1073741824" returned: 0 in 0.789s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:24 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c8a44fb1-0a34-4653-9984-98936c5eacc4" returned: 0 in 0.426s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:24 devstack sudo[95413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 Sep 23 00:20:24 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Lock "cinder-quobyte-c8a44fb1-0a34-4653-9984-98936c5eacc4" released by "delete_volume" :: held 1.132s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:24 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Created reservations ['b1316264-3483-4b4b-af33-e21973989cde', '08db3827-4a10-49be-b6e8-68c596c9af55', '439533dc-7b76-43fa-9c7c-6298e4e57286', 'd309261d-bc34-4829-a379-d5dc4bdf7f21', '26dfc91e-d4a1-45d8-ada8-1afc517f0ace'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:25 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14" returned: 0 in 0.441s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:25 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:20:25 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010730ef-3435-4e1d-9509-4ee1798c2194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb42aa23-7562-4082-9907-42950cf85a14', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a488fa-b678-42c2-8aeb-e47593ae7c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Volume volume-cb42aa23-7562-4082-9907-42950cf85a14 (cb42aa23-7562-4082-9907-42950cf85a14): created successfully Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a488fa-b678-42c2-8aeb-e47593ae7c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (dbdb9f70-0dcb-4c9b-92da-a8976adf604e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b1abf0d3-5996-43bc-945e-8bdc792d0cc2 tempest-VolumesSnapshotTestJSON-726412997 None] Created volume successfully. Sep 23 00:20:25 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.311s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Deleted volume successfully. Sep 23 00:20:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23f96832-4bd3-491e-aec4-1ff0e405e364 tempest-VolumesCloneNegativeTest-642541189 None] Lock "cinder-c8a44fb1-0a34-4653-9984-98936c5eacc4-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Creating offline snapshot 75c7b320-bae3-4a7f-a779-50b41df21a12 of volume cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:20:26 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0576a035-644b-453f-bc27-716e1c4a23c0]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:26 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 Sep 23 00:20:26 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:26 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14" returned: 0 in 0.685s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:26 devstack sudo[95455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 1G Sep 23 00:20:26 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:27 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 1G" returned: 0 in 0.718s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb42aa23-7562-4082-9907-42950cf85a14 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:27 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb42aa23-7562-4082-9907-42950cf85a14 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 Sep 23 00:20:27 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:28 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb42aa23-7562-4082-9907-42950cf85a14 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12" returned: 0 in 0.786s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:28 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 is being set with open permissions: ugo+rw Sep 23 00:20:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:28 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 Sep 23 00:20:28 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:28 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12" returned: 0 in 0.350s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:28 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.info Sep 23 00:20:28 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:29 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.info" returned: 0 in 0.651s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:29 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.info is being set with open permissions: ugo+rw Sep 23 00:20:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:29 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.info Sep 23 00:20:29 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:29 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.info" returned: 0 in 0.534s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.935s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:30 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c31d8c50-4660-4247-9c80-7bb4bb815901 tempest-VolumesSnapshotTestJSON-726412997 None] Create snapshot completed successfully Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (4c459ab3-97d6-4932-804c-1a79ffa2fbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a5d7d2-95cc-4066-b3f1-1fe5810e63b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-5596da93-92fe-43ec-b933-bf3f05929c72 req-9cbfd1b7-913d-4bba-9ec0-65ed1e240ba0 tempest-AttachVolumeTestJSON-1546700317 None] Terminate volume connection completed successfully. Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-5596da93-92fe-43ec-b933-bf3f05929c72 req-9cbfd1b7-913d-4bba-9ec0-65ed1e240ba0 tempest-AttachVolumeTestJSON-1546700317 None] Deleting attachment 522f9557-29b4-49b3-90a1-1ea5aa850d91. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a5d7d2-95cc-4066-b3f1-1fe5810e63b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-92623390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad64cca3f9d47fdabec79d83185f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:20:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=75c7b320-bae3-4a7f-a779-50b41df21a12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:20:32Z,use_quota=True,user_id='d00399fc513f455fafe449e016f1b8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a52a664-39aa-4f1d-8088-176d70676b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a52a664-39aa-4f1d-8088-176d70676b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c259301-226e-4961-9553-0c30270edc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c259301-226e-4961-9553-0c30270edc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf', 'volume_name': 'volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf', 'volume_size': 2, 'snapshot_id': '75c7b320-bae3-4a7f-a779-50b41df21a12'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7e304f-6500-4a00-aa87-d741fbc29ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba7e304f-6500-4a00-aa87-d741fbc29ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c11d8be-ea03-4e8e-8b15-3de405bb2737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:32 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Volume 24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf', 'volume_size': 2, 'snapshot_id': '75c7b320-bae3-4a7f-a779-50b41df21a12'} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-75c7b320-bae3-4a7f-a779-50b41df21a12-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" by "_create_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-75c7b320-bae3-4a7f-a779-50b41df21a12-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Creating volume 24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf from snapshot 75c7b320-bae3-4a7f-a779-50b41df21a12 {{(pid=87138) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] snapshot: 75c7b320-bae3-4a7f-a779-50b41df21a12, volume: 24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab5095c-aa1b-4867-acda-ab2db5bc68d9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:33 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 Sep 23 00:20:33 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:33 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12" returned: 0 in 0.940s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb42aa23-7562-4082-9907-42950cf85a14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:33 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd6c3a-63e1-420b-a225-4de61423f687]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:34 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 Sep 23 00:20:34 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:34 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14" returned: 0 in 0.965s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:20:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:20:34 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:20:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:34 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf Sep 23 00:20:34 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:42 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=12,cinder:SELECT=15,cinder:DELETE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:42 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=18,cinder:DELETE=3,cinder:SELECT=14,cinder:INSERT=7 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:20:49 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" returned: 0 in 14.262s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14, size 1024.00 MB, duration 14.26 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:20:49 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Converted 1024.00 MB image at 71.79 MB/s Sep 23 00:20:49 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf is being set with open permissions: ugo+rw Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:49 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf Sep 23 00:20:49 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:49 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" returned: 0 in 0.489s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" released by "_copy_volume_from_snapshot" :: held 16.921s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-75c7b320-bae3-4a7f-a779-50b41df21a12-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" released by "_create_volume_from_snapshot" :: held 17.057s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 17.115s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c11d8be-ea03-4e8e-8b15-3de405bb2737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf', 'volume_size': 2, 'snapshot_id': '75c7b320-bae3-4a7f-a779-50b41df21a12'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe1db8e-c786-4148-9a7c-6e59142c9284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:20:49 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Volume volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf (24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf): created successfully Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe1db8e-c786-4148-9a7c-6e59142c9284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:20:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (4c459ab3-97d6-4932-804c-1a79ffa2fbfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:20:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3c4adfc4-4f08-47a4-8f73-f99ea4edc7a0 tempest-VolumesSnapshotTestJSON-726412997 None] Created volume successfully. Sep 23 00:20:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" acquired by "delete_volume" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:50 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8080ec7b-0883-4a9e-ae99-48cbf5bede90]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:50 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf Sep 23 00:20:50 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:51 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" returned: 0 in 0.666s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:51 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf Sep 23 00:20:51 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:51 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" returned: 0 in 0.473s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf" released by "delete_volume" :: held 1.248s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Created reservations ['f1d14ca3-a54b-4dae-8c71-5b192c1d7b89', '6ff635e1-fdb5-4ce0-8150-bac95eeb8733', 'bae64b13-ea64-40bc-b3a0-e52b839f3c68', 'a3015961-5ef2-48d7-90d2-8f47a1c1590d', 'be45e254-0e39-4e51-982c-ca355ab2df48'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:52 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:20:52 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:52 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.578s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:20:52 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Deleted volume successfully. Sep 23 00:20:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d9180201-5da5-41d4-a087-e2317a2718cf tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-24ff3c31-5d2c-42c8-8fe2-34b8f44ef1cf-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-75c7b320-bae3-4a7f-a779-50b41df21a12-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-75c7b320-bae3-4a7f-a779-50b41df21a12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-cb42aa23-7562-4082-9907-42950cf85a14" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-cb42aa23-7562-4082-9907-42950cf85a14" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-75c7b320-bae3-4a7f-a779-50b41df21a12" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-75c7b320-bae3-4a7f-a779-50b41df21a12" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Deleting offline snapshot 75c7b320-bae3-4a7f-a779-50b41df21a12 of volume cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] snapshot_file for this snap is: volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[355c2819-33aa-4b40-8888-3535b2af8696]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:53 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 Sep 23 00:20:53 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:54 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12" returned: 0 in 0.730s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb42aa23-7562-4082-9907-42950cf85a14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:20:54 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca1399d-4f3e-4809-ab12-3d8f76ee5e3b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:54 devstack sudo[95710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 Sep 23 00:20:54 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:55 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14" returned: 0 in 0.901s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:55 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 Sep 23 00:20:55 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:56 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12" returned: 0 in 0.974s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:56 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12 Sep 23 00:20:56 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:56 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14.75c7b320-bae3-4a7f-a779-50b41df21a12" returned: 0 in 0.818s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-75c7b320-bae3-4a7f-a779-50b41df21a12" released by "_delete_snapshot" :: held 3.769s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-cb42aa23-7562-4082-9907-42950cf85a14" released by "delete_snapshot" :: held 3.817s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:57 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Created reservations ['0caf4682-2546-4a7e-a1b7-940da1f59cff', '2a38a89f-6590-49a7-b7f8-72eb9f1cbeca', '34d93a2f-917f-4a8c-8e7d-d204451af079', '7c5b0369-8b8f-44fc-ad71-d61b59f2e7aa', 'c9b81790-f47c-48f4-ba67-bec040cd4e2a'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Delete snapshot completed successfully. Sep 23 00:20:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7f0c19d2-a53d-4ba0-9c65-4b6569e566ec tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-75c7b320-bae3-4a7f-a779-50b41df21a12-delete_snapshot" released by "delete_snapshot" :: held 4.311s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-cb42aa23-7562-4082-9907-42950cf85a14-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-cb42aa23-7562-4082-9907-42950cf85a14-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-cb42aa23-7562-4082-9907-42950cf85a14" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:20:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-cb42aa23-7562-4082-9907-42950cf85a14" acquired by "delete_volume" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:20:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca79da9-cfa6-47b8-bf4e-da5c3f603e90]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:20:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:58 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 Sep 23 00:20:58 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:59 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14" returned: 0 in 0.643s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:59 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14 Sep 23 00:20:59 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:20:59 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cb42aa23-7562-4082-9907-42950cf85a14" returned: 0 in 0.507s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-cb42aa23-7562-4082-9907-42950cf85a14" released by "delete_volume" :: held 1.273s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Created reservations ['7c88563f-76a6-45fa-85e2-11c183dcfc4e', 'b8055b71-d7d5-4904-8557-e9eb799e5e1a', '309d0fc3-d17e-4d32-9f8c-17787798b76f', '70ba426a-500b-4686-9d0c-e792fcdda8e2', 'b69f903f-5c5f-46f6-a62e-1091aba4f805'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:20:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:20:59 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:20:59 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:00 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.437s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:00 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:00 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Deleted volume successfully. Sep 23 00:21:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b4bc78e1-cd2c-416b-b1a5-b1ca5c1703db tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-cb42aa23-7562-4082-9907-42950cf85a14-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:01 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (e86058f5-a771-4622-8dbc-c95dd9e00f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5584ad09-c119-4704-8a21-9c2aa415ad2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5584ad09-c119-4704-8a21-9c2aa415ad2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-91076249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c4c396-a834-40c3-88cc-8810643fe631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad64cca3f9d47fdabec79d83185f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:02Z,use_quota=True,user_id='d00399fc513f455fafe449e016f1b8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1769b3ce-45b0-4df7-a20e-a41ad75fc425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1769b3ce-45b0-4df7-a20e-a41ad75fc425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e55f4f-29e5-4be5-bda9-f7c7e42d2313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e55f4f-29e5-4be5-bda9-f7c7e42d2313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c4c396-a834-40c3-88cc-8810643fe631', 'volume_name': 'volume-d7c4c396-a834-40c3-88cc-8810643fe631', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684eb4a4-5c76-48dd-be39-ab1a40733280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (684eb4a4-5c76-48dd-be39-ab1a40733280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7ac71a-57a1-4d61-9bb2-38d69589bb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:02 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Volume d7c4c396-a834-40c3-88cc-8810643fe631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c4c396-a834-40c3-88cc-8810643fe631', 'volume_size': 1} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-91076249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c4c396-a834-40c3-88cc-8810643fe631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad64cca3f9d47fdabec79d83185f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:02Z,use_quota=True,user_id='d00399fc513f455fafe449e016f1b8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Creating volume d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:02 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:02 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 1073741824 Sep 23 00:21:02 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:02 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:21:02 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 1073741824" returned: 0 in 0.723s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:02 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:03 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 Sep 23 00:21:03 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:03 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631" returned: 0 in 0.363s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7ac71a-57a1-4d61-9bb2-38d69589bb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c4c396-a834-40c3-88cc-8810643fe631', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef1bf1e-415e-4773-9ffd-6dc0486c9585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:03 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.570s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:03 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Volume volume-d7c4c396-a834-40c3-88cc-8810643fe631 (d7c4c396-a834-40c3-88cc-8810643fe631): created successfully Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef1bf1e-415e-4773-9ffd-6dc0486c9585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (e86058f5-a771-4622-8dbc-c95dd9e00f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:21:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:21:03 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-33258e62-43a4-4a1d-bd97-75846ded120e tempest-VolumesSnapshotTestJSON-726412997 None] Created volume successfully. Sep 23 00:21:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Creating offline snapshot ba5ac7ea-40b1-4d91-8977-3dc2012b1814 of volume d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:21:04 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded1acae-31c0-478d-8f46-2f2d30b43333]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:04 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 Sep 23 00:21:04 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:04 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631" returned: 0 in 0.539s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:04 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 1G Sep 23 00:21:04 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:05 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 1G" returned: 0 in 0.589s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7c4c396-a834-40c3-88cc-8810643fe631 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7c4c396-a834-40c3-88cc-8810643fe631 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 Sep 23 00:21:05 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:05 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7c4c396-a834-40c3-88cc-8810643fe631 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814" returned: 0 in 0.461s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:05 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 is being set with open permissions: ugo+rw Sep 23 00:21:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:05 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 Sep 23 00:21:05 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:06 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814" returned: 0 in 0.316s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:06 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.info Sep 23 00:21:06 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:06 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.info" returned: 0 in 0.328s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.info is being set with open permissions: ugo+rw Sep 23 00:21:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:06 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.info Sep 23 00:21:06 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:06 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.info" returned: 0 in 0.338s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-447932e9-daf7-4f90-abc3-e6686996ffd2 tempest-VolumesSnapshotTestJSON-726412997 None] Create snapshot completed successfully Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (41b18a45-ac21-4497-aef7-5933cd5e20db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3161e2-1a23-404b-85c3-f403cfed9621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e3161e2-1a23-404b-85c3-f403cfed9621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-701163681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d647ac-6c96-40ea-8d45-75ca3506b9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ad64cca3f9d47fdabec79d83185f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba5ac7ea-40b1-4d91-8977-3dc2012b1814,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:08Z,use_quota=True,user_id='d00399fc513f455fafe449e016f1b8fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea28db21-fb2e-4d6c-8dd6-c95b2e811d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea28db21-fb2e-4d6c-8dd6-c95b2e811d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5467b0cd-f515-4584-af4b-5faf0d852e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5467b0cd-f515-4584-af4b-5faf0d852e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13d647ac-6c96-40ea-8d45-75ca3506b9fb', 'volume_name': 'volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb', 'volume_size': 1, 'snapshot_id': 'ba5ac7ea-40b1-4d91-8977-3dc2012b1814'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b300712e-7783-4f6b-bf46-f73c5386368e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b300712e-7783-4f6b-bf46-f73c5386368e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c345c5-5f2e-4c60-a8d2-26466ee91ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:08 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Volume 13d647ac-6c96-40ea-8d45-75ca3506b9fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb', 'volume_size': 1, 'snapshot_id': 'ba5ac7ea-40b1-4d91-8977-3dc2012b1814'} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-ba5ac7ea-40b1-4d91-8977-3dc2012b1814-13d647ac-6c96-40ea-8d45-75ca3506b9fb" by "_create_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-ba5ac7ea-40b1-4d91-8977-3dc2012b1814-13d647ac-6c96-40ea-8d45-75ca3506b9fb" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Creating volume 13d647ac-6c96-40ea-8d45-75ca3506b9fb from snapshot ba5ac7ea-40b1-4d91-8977-3dc2012b1814 {{(pid=87138) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-13d647ac-6c96-40ea-8d45-75ca3506b9fb" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-13d647ac-6c96-40ea-8d45-75ca3506b9fb" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] snapshot: ba5ac7ea-40b1-4d91-8977-3dc2012b1814, volume: 13d647ac-6c96-40ea-8d45-75ca3506b9fb, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2d2906-33d4-4c15-8cc9-9471e29813be]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:08 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 Sep 23 00:21:08 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:09 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814" returned: 0 in 1.019s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7c4c396-a834-40c3-88cc-8810643fe631(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:09 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d483109-7aef-489b-a333-54c48700bc5d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:10 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 Sep 23 00:21:10 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:10 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631" returned: 0 in 1.014s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:21:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:21:10 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:21:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:10 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb Sep 23 00:21:10 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=33,cinder:UPDATE=34,cinder:DELETE=1,cinder:INSERT=8 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=23,cinder:INSERT=10,cinder:UPDATE=31,cinder:DELETE=4 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:21:22 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb" returned: 0 in 12.021s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:22 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631, size 1024.00 MB, duration 12.02 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:21:22 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Converted 1024.00 MB image at 85.16 MB/s Sep 23 00:21:22 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb is being set with open permissions: ugo+rw Sep 23 00:21:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:22 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb Sep 23 00:21:22 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:23 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb" returned: 0 in 0.403s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-13d647ac-6c96-40ea-8d45-75ca3506b9fb" released by "_copy_volume_from_snapshot" :: held 14.758s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-ba5ac7ea-40b1-4d91-8977-3dc2012b1814-13d647ac-6c96-40ea-8d45-75ca3506b9fb" released by "_create_volume_from_snapshot" :: held 14.886s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.919s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c345c5-5f2e-4c60-a8d2-26466ee91ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb', 'volume_size': 1, 'snapshot_id': 'ba5ac7ea-40b1-4d91-8977-3dc2012b1814'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47cbdd0-a1bf-4c97-a2e8-ba500bd5690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Volume volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb (13d647ac-6c96-40ea-8d45-75ca3506b9fb): created successfully Sep 23 00:21:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47cbdd0-a1bf-4c97-a2e8-ba500bd5690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Flow 'volume_create_manager' (41b18a45-ac21-4497-aef7-5933cd5e20db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:23 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-17ef9922-ac86-4add-b53f-85d5dab3f15d tempest-VolumesSnapshotTestJSON-726412997 None] Created volume successfully. Sep 23 00:21:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Acquiring lock "cinder-1afdc078-d8e5-4e82-a210-c8d64d608636-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "cinder-1afdc078-d8e5-4e82-a210-c8d64d608636-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Acquiring lock "cinder-quobyte-1afdc078-d8e5-4e82-a210-c8d64d608636" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "cinder-quobyte-1afdc078-d8e5-4e82-a210-c8d64d608636" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:24 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[26907acd-93fe-400e-ac3b-897a10da8ed8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-13d647ac-6c96-40ea-8d45-75ca3506b9fb-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:24 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636 Sep 23 00:21:24 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-13d647ac-6c96-40ea-8d45-75ca3506b9fb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-13d647ac-6c96-40ea-8d45-75ca3506b9fb" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-13d647ac-6c96-40ea-8d45-75ca3506b9fb" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db01612-ae17-4274-a68c-be0636d5a7b0]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:25 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb Sep 23 00:21:25 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:25 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636" returned: 0 in 0.582s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:25 devstack sudo[95919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636 Sep 23 00:21:25 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:25 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb" returned: 0 in 0.584s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:25 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb Sep 23 00:21:25 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:25 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1afdc078-d8e5-4e82-a210-c8d64d608636" returned: 0 in 0.396s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "cinder-quobyte-1afdc078-d8e5-4e82-a210-c8d64d608636" released by "delete_volume" :: held 1.054s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:25 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Created reservations ['cef75e36-7c67-4440-80f9-89eafaa8ec33', '54affd77-9418-4b07-8f7c-cec5d4cbf715', '258f37ae-c77e-48c2-a9d3-21c6c2844e9c', 'b82a37bd-d1a0-4e96-80c4-a8fb8443eb90', '83e49cdf-b8cc-452b-b8cf-72dfe22d4c7d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:26 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:21:26 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:26 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-13d647ac-6c96-40ea-8d45-75ca3506b9fb" returned: 0 in 0.511s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-13d647ac-6c96-40ea-8d45-75ca3506b9fb" released by "delete_volume" :: held 1.161s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Created reservations ['6299069b-e3e1-47a7-8ff3-16187e517fa5', '92cbad20-7af0-4abf-a38e-3e2b09bfcc76', '838a4a0e-04f9-43d8-84d6-94ee78783af9', '8e0e390e-65b6-4d55-be4c-a45e42674e41', '04ffbdcb-44df-48de-94e9-4eba23abb35f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:26 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:21:26 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:26 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.400s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Deleted volume successfully. Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-764913da-6a74-4a4e-bf4c-d0673c72bcb3 tempest-AttachVolumeShelveTestJSON-864427319 None] Lock "cinder-1afdc078-d8e5-4e82-a210-c8d64d608636-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:26 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.413s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Deleted volume successfully. Sep 23 00:21:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d6996bef-05ad-4ffc-9520-dbc1d2809b64 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-13d647ac-6c96-40ea-8d45-75ca3506b9fb-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-ba5ac7ea-40b1-4d91-8977-3dc2012b1814-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-ba5ac7ea-40b1-4d91-8977-3dc2012b1814-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-d7c4c396-a834-40c3-88cc-8810643fe631" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-d7c4c396-a834-40c3-88cc-8810643fe631" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-ba5ac7ea-40b1-4d91-8977-3dc2012b1814" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-ba5ac7ea-40b1-4d91-8977-3dc2012b1814" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Deleting offline snapshot ba5ac7ea-40b1-4d91-8977-3dc2012b1814 of volume d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] snapshot_file for this snap is: volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a9e43c-16e5-4fe0-a23e-b930b21101e3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:27 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 Sep 23 00:21:27 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Flow 'volume_create_manager' (050cbdfe-643a-4316-b1ae-4b05bedde91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfdc848-1a59-441a-a1e9-ddfb06d4cb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bfdc848-1a59-441a-a1e9-ddfb06d4cb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1484178653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286cfd93-d4c3-4a62-9b72-20ddd6075eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821c871496eb4573b5411bc015411ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:28Z,use_quota=True,user_id='4bc64cad2ba4475782dced6edb440cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11e82a4-be1d-445d-b519-68b92691f6a1),volume_type_id=d11e82a4-be1d-445d-b519-68b92691f6a1)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3188d9-4a4b-4ffd-acf9-4bed8068f978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3188d9-4a4b-4ffd-acf9-4bed8068f978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97617f39-6f9c-4e66-9a25-cc48cf86a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97617f39-6f9c-4e66-9a25-cc48cf86a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286cfd93-d4c3-4a62-9b72-20ddd6075eeb', 'volume_name': 'volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd2764a-d0fd-4237-a819-61b9e386eead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd2764a-d0fd-4237-a819-61b9e386eead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e6958b-66de-4300-b46b-25359c996ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Volume 286cfd93-d4c3-4a62-9b72-20ddd6075eeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb', 'volume_size': 1} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1484178653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286cfd93-d4c3-4a62-9b72-20ddd6075eeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821c871496eb4573b5411bc015411ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:28Z,use_quota=True,user_id='4bc64cad2ba4475782dced6edb440cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d11e82a4-be1d-445d-b519-68b92691f6a1),volume_type_id=d11e82a4-be1d-445d-b519-68b92691f6a1)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Creating volume 286cfd93-d4c3-4a62-9b72-20ddd6075eeb {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:28 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:28 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:28 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb 1073741824 Sep 23 00:21:28 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814" returned: 0 in 0.717s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7c4c396-a834-40c3-88cc-8810643fe631(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[820b44a2-00fb-4ee9-a14c-3761a6950e3a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:28 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 Sep 23 00:21:28 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Flow 'volume_create_manager' (cec73e3c-ff3d-4658-bef6-9b8ea10a6e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843efd84-2f52-47c6-88ab-1b5307dcb99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843efd84-2f52-47c6-88ab-1b5307dcb99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1346833308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b059badc-c8cb-4129-882f-14e8e708dc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821c871496eb4573b5411bc015411ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:29Z,use_quota=True,user_id='4bc64cad2ba4475782dced6edb440cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20384e11-2ef3-4bce-939f-97347f0c09a2),volume_type_id=20384e11-2ef3-4bce-939f-97347f0c09a2)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdfbad2-34bd-4e99-89bb-e8340991bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdfbad2-34bd-4e99-89bb-e8340991bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d77e567-e0cf-46b1-bcc0-3d9993e1df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d77e567-e0cf-46b1-bcc0-3d9993e1df1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b059badc-c8cb-4129-882f-14e8e708dc88', 'volume_name': 'volume-b059badc-c8cb-4129-882f-14e8e708dc88', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a82b8ce-d480-4ad9-9bdc-b38cc09d1b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a82b8ce-d480-4ad9-9bdc-b38cc09d1b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02827242-f6c6-4c49-a90a-0a166a388944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:29 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Volume b059badc-c8cb-4129-882f-14e8e708dc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b059badc-c8cb-4129-882f-14e8e708dc88', 'volume_size': 1} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:29 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb 1073741824" returned: 0 in 0.970s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:29 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb Sep 23 00:21:29 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:29 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631" returned: 0 in 0.988s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:29 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 Sep 23 00:21:29 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:29 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb" returned: 0 in 0.455s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1346833308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b059badc-c8cb-4129-882f-14e8e708dc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821c871496eb4573b5411bc015411ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:29Z,use_quota=True,user_id='4bc64cad2ba4475782dced6edb440cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20384e11-2ef3-4bce-939f-97347f0c09a2),volume_type_id=20384e11-2ef3-4bce-939f-97347f0c09a2)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Creating volume b059badc-c8cb-4129-882f-14e8e708dc88 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:29 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e6958b-66de-4300-b46b-25359c996ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2cd414-8e26-4f77-97f2-80a66c2eb38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:29 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88 1073741824 Sep 23 00:21:29 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:29 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Volume volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb (286cfd93-d4c3-4a62-9b72-20ddd6075eeb): created successfully Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2cd414-8e26-4f77-97f2-80a66c2eb38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Flow 'volume_create_manager' (050cbdfe-643a-4316-b1ae-4b05bedde91a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e2874177-5319-45fb-9b20-700d712cc1aa tempest-TestInstancesWithCinderVolumes-509314505 None] Created volume successfully. Sep 23 00:21:30 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814" returned: 0 in 0.779s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:30 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814 Sep 23 00:21:30 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Flow 'volume_create_manager' (8aaf4b59-f4af-4ebd-aa89-89574c6bc4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaecff8-9aed-4ae3-bbad-02ebda874489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aaecff8-9aed-4ae3-bbad-02ebda874489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2143114847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821c871496eb4573b5411bc015411ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:30Z,use_quota=True,user_id='4bc64cad2ba4475782dced6edb440cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7caff360-60ae-431a-9085-290114daa66a),volume_type_id=7caff360-60ae-431a-9085-290114daa66a)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5345495b-9e3e-416a-aaf4-84654117ec69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5345495b-9e3e-416a-aaf4-84654117ec69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ffd847-3c79-48d4-b782-9c34db14a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:21:30 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631.ba5ac7ea-40b1-4d91-8977-3dc2012b1814" returned: 0 in 0.586s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:30 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88 1073741824" returned: 0 in 1.045s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-ba5ac7ea-40b1-4d91-8977-3dc2012b1814" released by "_delete_snapshot" :: held 3.315s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-d7c4c396-a834-40c3-88cc-8810643fe631" released by "delete_snapshot" :: held 3.389s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:30 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88 Sep 23 00:21:30 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Created reservations ['eb4dab67-6723-472e-92a5-ef32cf71f0c9', 'c1f643c4-e173-4277-a7cd-cd8490c9d812', 'b3f1bfca-2f29-4629-ad2a-4932be4d9fb9', 'f488a0b8-1f87-4a9c-b168-23977f33fc35', '4f01086e-6108-4b11-9655-9b21d168d802'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ffd847-3c79-48d4-b782-9c34db14a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00', 'volume_name': 'volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00', 'volume_size': 1, 'image_id': '4207a3c0-3a65-46e2-b811-1109c6401588', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4207a3c0-3a65-46e2-b811-1109c6401588', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1119737240', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '821c871496eb4573b5411bc015411ec2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4207a3c0-3a65-46e2-b811-1109c6401588', 'created_at': datetime.datetime(2026, 9, 22, 22, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 21, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4207a3c0-3a65-46e2-b811-1109c6401588/file', 'properties': {}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668e7a89-a431-47af-b78f-fe958350ad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668e7a89-a431-47af-b78f-fe958350ad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e91da6c-667d-4283-b927-d3c4fe205802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:31 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Volume 6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00', 'volume_size': 1, 'image_id': '4207a3c0-3a65-46e2-b811-1109c6401588', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4207a3c0-3a65-46e2-b811-1109c6401588', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1119737240', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '821c871496eb4573b5411bc015411ec2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4207a3c0-3a65-46e2-b811-1109c6401588', 'created_at': datetime.datetime(2026, 9, 22, 22, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 21, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4207a3c0-3a65-46e2-b811-1109c6401588/file', 'properties': {}}, 'image_service': } Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Trying to clone 6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 from image 4207a3c0-3a65-46e2-b811-1109c6401588 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4207a3c0-3a65-46e2-b811-1109c6401588', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:21:31 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Delete snapshot completed successfully. Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-140a13db-5c60-4298-ad45-683cad6734b0 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-ba5ac7ea-40b1-4d91-8977-3dc2012b1814-delete_snapshot" released by "delete_snapshot" :: held 3.888s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:31 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88" returned: 0 in 0.487s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02827242-f6c6-4c49-a90a-0a166a388944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b059badc-c8cb-4129-882f-14e8e708dc88', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae369a5c-dccc-41f1-b1bc-5030a4971328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:31 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Volume volume-b059badc-c8cb-4129-882f-14e8e708dc88 (b059badc-c8cb-4129-882f-14e8e708dc88): created successfully Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae369a5c-dccc-41f1-b1bc-5030a4971328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Flow 'volume_create_manager' (cec73e3c-ff3d-4658-bef6-9b8ea10a6e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:31 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e9f7f565-16cd-4a01-be0c-ab73c9c79bab tempest-TestInstancesWithCinderVolumes-509314505 None] Created volume successfully. Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-d7c4c396-a834-40c3-88cc-8810643fe631-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-d7c4c396-a834-40c3-88cc-8810643fe631-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-d7c4c396-a834-40c3-88cc-8810643fe631" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-d7c4c396-a834-40c3-88cc-8810643fe631" acquired by "delete_volume" :: waited 0.031s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:32 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0033415a-3385-4d70-8c50-c2bdda5f597c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:32 devstack sudo[95977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 Sep 23 00:21:32 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:32 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631" returned: 0 in 0.648s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:32 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631 Sep 23 00:21:32 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:33 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7c4c396-a834-40c3-88cc-8810643fe631" returned: 0 in 0.400s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-d7c4c396-a834-40c3-88cc-8810643fe631" released by "delete_volume" :: held 1.156s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Created reservations ['c78143b8-372d-4418-9123-2f2ebfe085d4', 'a7ea4cde-94c2-4947-b373-ff982ddd599d', '0133f6dd-d312-4f6e-a503-47f008c5aed9', '2531271d-df95-4721-b3bf-9a7c1a2b373e', 'bc2b3c7a-9cb0-4eea-a308-19d5cd2d5118'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:33 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:21:33 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:33 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.496s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Deleted volume successfully. Sep 23 00:21:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f29d8d6-dd59-4416-8485-5bda75c4fcac tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-d7c4c396-a834-40c3-88cc-8810643fe631-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-418b3487-cca6-4471-be07-5fccb433b1cf-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-418b3487-cca6-4471-be07-5fccb433b1cf-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "cinder-quobyte-418b3487-cca6-4471-be07-5fccb433b1cf" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-418b3487-cca6-4471-be07-5fccb433b1cf" acquired by "delete_volume" :: waited 0.031s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:34 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c42238-2ae7-4a28-a786-7547499dce57]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:34 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf Sep 23 00:21:34 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:35 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf" returned: 0 in 0.697s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:35 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf Sep 23 00:21:35 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:35 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-418b3487-cca6-4471-be07-5fccb433b1cf" returned: 0 in 0.567s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-quobyte-418b3487-cca6-4471-be07-5fccb433b1cf" released by "delete_volume" :: held 1.434s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Created reservations ['25fcaeee-6b9e-482b-8236-9651191b1761', '30981402-0de7-41eb-81de-2e2080cd9371', '0a336519-6cfe-46b8-a2a9-1d8a9fcc45f9', 'e9ef6b38-f513-459c-9fcb-4ee191f4aa8c', '5ea9cf73-83bd-4c09-a8f2-f3caeb61432f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:36 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:21:36 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:36 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.513s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:21:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Deleted volume successfully. Sep 23 00:21:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2e54f321-b551-4fcb-b7b3-724d8ca49c09 tempest-VolumesSnapshotTestJSON-726412997 None] Lock "cinder-418b3487-cca6-4471-be07-5fccb433b1cf-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:38 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD, size 20.69 MB, duration 7.39 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:21:38 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Image download 20.69 MB at 2.80 MB/s Sep 23 00:21:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf213aa-4890-444e-a522-65b509c11589]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:38 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD Sep 23 00:21:38 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:39 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Temporary image 4207a3c0-3a65-46e2-b811-1109c6401588 is fetched for user 4bc64cad2ba4475782dced6edb440cc8. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1535d651-0ed4-4d98-952a-3af1d612a25f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:39 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD Sep 23 00:21:39 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:39 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2143114847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821c871496eb4573b5411bc015411ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:30Z,use_quota=True,user_id='4bc64cad2ba4475782dced6edb440cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7caff360-60ae-431a-9085-290114daa66a),volume_type_id=7caff360-60ae-431a-9085-290114daa66a)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Creating volume 6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:39 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:21:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:39 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 1073741824 Sep 23 00:21:39 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:40 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 1073741824" returned: 0 in 0.848s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:40 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 Sep 23 00:21:40 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:41 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00" returned: 0 in 0.528s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:41 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Attempting download of 4207a3c0-3a65-46e2-b811-1109c6401588 ((None, [{'url': 'file:///opt/stack/data/glance/images/4207a3c0-3a65-46e2-b811-1109c6401588', 'metadata': {}}])) to volume 6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:21:41 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[215e4095-b24e-44bc-928f-da2f5c2b6f36]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4207a3c0-3a65-46e2-b811-1109c6401588_mkhabtje {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:41 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4207a3c0-3a65-46e2-b811-1109c6401588_mkhabtje Sep 23 00:21:41 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:42 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4207a3c0-3a65-46e2-b811-1109c6401588_mkhabtje" returned: 0 in 0.677s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4207a3c0-3a65-46e2-b811-1109c6401588_mkhabtje {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:42 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4207a3c0-3a65-46e2-b811-1109c6401588_mkhabtje Sep 23 00:21:42 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:42 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4207a3c0-3a65-46e2-b811-1109c6401588_mkhabtje" returned: 1 in 0.513s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4207a3c0-3a65-46e2-b811-1109c6401588_mkhabtje' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:21:42 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20be339-55ef-48b9-b3f5-f3b371f1f918]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:42 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD Sep 23 00:21:42 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:43 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD" returned: 0 in 1.029s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:43 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] 4207a3c0-3a65-46e2-b811-1109c6401588 was qcow2, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:21:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:43 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 Sep 23 00:21:43 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Flow 'volume_create_manager' (b5b7777a-649b-4a5c-9fd1-a8d57086a5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef11c40-ee02-4514-96de-f21f2f578181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef11c40-ee02-4514-96de-f21f2f578181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-232473516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78db2ae-703b-4b90-a765-7af618ccc48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2a8e3729eb4d798036d75fb3736c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:45Z,use_quota=True,user_id='6734a49378a74a059dd5802ac1df3d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0498510-dc5f-4d43-81e5-161a74daafe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0498510-dc5f-4d43-81e5-161a74daafe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ecfb8d-b09d-4555-a45a-b548b3741b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ecfb8d-b09d-4555-a45a-b548b3741b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78db2ae-703b-4b90-a765-7af618ccc48c', 'volume_name': 'volume-c78db2ae-703b-4b90-a765-7af618ccc48c', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919d3ef4-a2f3-4d94-859b-aa7d6868ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919d3ef4-a2f3-4d94-859b-aa7d6868ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94139f7-8753-4546-89b5-7a0435d588ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Volume c78db2ae-703b-4b90-a765-7af618ccc48c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78db2ae-703b-4b90-a765-7af618ccc48c', 'volume_size': 1} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-232473516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78db2ae-703b-4b90-a765-7af618ccc48c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e2a8e3729eb4d798036d75fb3736c7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:45Z,use_quota=True,user_id='6734a49378a74a059dd5802ac1df3d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Creating volume c78db2ae-703b-4b90-a765-7af618ccc48c {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:45 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:21:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:45 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c 1073741824 Sep 23 00:21:45 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:46 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c 1073741824" returned: 0 in 1.065s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:46 devstack sudo[96143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c Sep 23 00:21:46 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:47 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c" returned: 0 in 0.609s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94139f7-8753-4546-89b5-7a0435d588ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78db2ae-703b-4b90-a765-7af618ccc48c', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6005e0b6-e9cf-4890-9762-e05727635b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:47 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Volume volume-c78db2ae-703b-4b90-a765-7af618ccc48c (c78db2ae-703b-4b90-a765-7af618ccc48c): created successfully Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6005e0b6-e9cf-4890-9762-e05727635b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Flow 'volume_create_manager' (b5b7777a-649b-4a5c-9fd1-a8d57086a5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-83545068-23eb-4120-9af2-6b1ee0d95474 req-3879c721-53b7-43e4-bbd1-a28b740daada tempest-VolumesSnapshotsTestJSON-758457529 None] Created volume successfully. Sep 23 00:21:47 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00" returned: 0 in 4.214s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4207a3c0-3a65-46e2-b811-1109c6401588_xhfgmewvdevstack@QuobyteHD, size 112.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:21:47 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Converted 112.00 MB image at 26.57 MB/s Sep 23 00:21:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:47 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 1G Sep 23 00:21:47 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:48 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 1G" returned: 0 in 0.499s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Downloaded image 4207a3c0-3a65-46e2-b811-1109c6401588 ((None, [{'url': 'file:///opt/stack/data/glance/images/4207a3c0-3a65-46e2-b811-1109c6401588', 'metadata': {}}])) to volume 6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Temporary image 4207a3c0-3a65-46e2-b811-1109c6401588 for user 4bc64cad2ba4475782dced6edb440cc8 is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Marking volume 6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Copying metadata from image 4207a3c0-3a65-46e2-b811-1109c6401588 to 6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Creating volume glance metadata for volume 6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 backed by image 4207a3c0-3a65-46e2-b811-1109c6401588 with: {'image_id': '4207a3c0-3a65-46e2-b811-1109c6401588', 'image_name': 'tempest-scenario-img--1119737240', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e91da6c-667d-4283-b927-d3c4fe205802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00', 'volume_size': 1, 'image_id': '4207a3c0-3a65-46e2-b811-1109c6401588', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4207a3c0-3a65-46e2-b811-1109c6401588', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1119737240', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '821c871496eb4573b5411bc015411ec2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4207a3c0-3a65-46e2-b811-1109c6401588', 'created_at': datetime.datetime(2026, 9, 22, 22, 21, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 21, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4207a3c0-3a65-46e2-b811-1109c6401588/file', 'properties': {}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b18169-4730-4375-914c-ed3241109ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:48 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Volume volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 (6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00): created successfully Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b18169-4730-4375-914c-ed3241109ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Flow 'volume_create_manager' (8aaf4b59-f4af-4ebd-aa89-89574c6bc4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:48 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6bb48978-1aff-46bc-b150-78cca01a3a3b tempest-TestInstancesWithCinderVolumes-509314505 None] Created volume successfully. Sep 23 00:21:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Creating offline snapshot 2f460177-6db9-4d3f-a1f8-c96e1e0ca94a of volume c78db2ae-703b-4b90-a765-7af618ccc48c {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:21:49 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9194b1d6-11dc-4335-bc71-7770f8d93a45]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:49 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c Sep 23 00:21:49 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:50 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c" returned: 0 in 0.877s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:50 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a 1G Sep 23 00:21:50 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:50 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a 1G" returned: 0 in 0.861s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78db2ae-703b-4b90-a765-7af618ccc48c -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:51 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78db2ae-703b-4b90-a765-7af618ccc48c -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a Sep 23 00:21:51 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:51 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c78db2ae-703b-4b90-a765-7af618ccc48c -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a" returned: 0 in 0.496s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:51 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a is being set with open permissions: ugo+rw Sep 23 00:21:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:51 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a Sep 23 00:21:51 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:51 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a" returned: 0 in 0.449s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:52 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.info Sep 23 00:21:52 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:52 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.info" returned: 0 in 0.481s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:52 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.info is being set with open permissions: ugo+rw Sep 23 00:21:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:52 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.info Sep 23 00:21:52 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:53 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.info" returned: 0 in 0.510s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.872s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-ab07187a-3bcd-4e81-a38e-15318fb360f8 req-5a412fa3-16f8-488a-800d-6f6984028591 tempest-VolumesSnapshotsTestJSON-758457529 None] Create snapshot completed successfully Sep 23 00:21:53 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:21:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Flow 'volume_create_manager' (6cbc05a6-fd21-41fb-989b-4661b07e1075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1673bd-0387-44f1-b173-8d882393f28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac1673bd-0387-44f1-b173-8d882393f28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1377871176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43118dda-b682-461d-b331-1792b8b8124b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89385bedef3c40549d2f93dba58fd84c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:54Z,use_quota=True,user_id='5ba8edd32ae9470ea26c71f89ce27c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dbd61b-6cef-4d3d-afe1-abc996e14304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67dbd61b-6cef-4d3d-afe1-abc996e14304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fda3767-bc41-4db9-95a6-60e786869c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fda3767-bc41-4db9-95a6-60e786869c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43118dda-b682-461d-b331-1792b8b8124b', 'volume_name': 'volume-43118dda-b682-461d-b331-1792b8b8124b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cf25c0-88cf-4e71-bf4d-6660baffcd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cf25c0-88cf-4e71-bf4d-6660baffcd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a08b3-9935-42b1-860c-3c2394eb669b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:54 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Volume 43118dda-b682-461d-b331-1792b8b8124b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43118dda-b682-461d-b331-1792b8b8124b', 'volume_size': 1} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1377871176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43118dda-b682-461d-b331-1792b8b8124b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89385bedef3c40549d2f93dba58fd84c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:21:54Z,use_quota=True,user_id='5ba8edd32ae9470ea26c71f89ce27c38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Creating volume 43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:21:54 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Acquiring lock "cinder-2f460177-6db9-4d3f-a1f8-c96e1e0ca94a-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:54 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b 1073741824 Sep 23 00:21:54 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-2f460177-6db9-4d3f-a1f8-c96e1e0ca94a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.115s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Acquiring lock "cinder-quobyte-c78db2ae-703b-4b90-a765-7af618ccc48c" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-quobyte-c78db2ae-703b-4b90-a765-7af618ccc48c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Acquiring lock "cinder-quobyte-2f460177-6db9-4d3f-a1f8-c96e1e0ca94a" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-quobyte-2f460177-6db9-4d3f-a1f8-c96e1e0ca94a" acquired by "_delete_snapshot" :: waited 0.082s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Deleting offline snapshot 2f460177-6db9-4d3f-a1f8-c96e1e0ca94a of volume c78db2ae-703b-4b90-a765-7af618ccc48c {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] snapshot_file for this snap is: volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d27a018-e27f-4f8b-a60b-857d48724b94]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:54 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a Sep 23 00:21:54 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-490e6bb6-1bec-42fa-af9b-bdd220c703a5 req-458a283e-4dac-4fe8-95e9-c185817ebc7a tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:55 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a" returned: 0 in 0.868s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c78db2ae-703b-4b90-a765-7af618ccc48c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:21:55 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b 1073741824" returned: 0 in 1.381s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:55 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d208540-b7a6-4305-819a-86106486b172]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:55 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b Sep 23 00:21:55 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:55 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c Sep 23 00:21:55 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:56 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b" returned: 0 in 0.611s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-490e6bb6-1bec-42fa-af9b-bdd220c703a5 req-458a283e-4dac-4fe8-95e9-c185817ebc7a tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.867s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432a08b3-9935-42b1-860c-3c2394eb669b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43118dda-b682-461d-b331-1792b8b8124b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4519ea12-efc9-44a0-8255-ae6be9ad847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-490e6bb6-1bec-42fa-af9b-bdd220c703a5 req-458a283e-4dac-4fe8-95e9-c185817ebc7a tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.077s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:21:56 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Volume volume-43118dda-b682-461d-b331-1792b8b8124b (43118dda-b682-461d-b331-1792b8b8124b): created successfully Sep 23 00:21:56 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4519ea12-efc9-44a0-8255-ae6be9ad847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Flow 'volume_create_manager' (6cbc05a6-fd21-41fb-989b-4661b07e1075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c" returned: 0 in 0.870s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-236c5a16-b998-4bec-a74d-625760547e4b tempest-VolumesSnapshotListTestJSON-2005516907 None] Created volume successfully. Sep 23 00:21:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-490e6bb6-1bec-42fa-af9b-bdd220c703a5 req-458a283e-4dac-4fe8-95e9-c185817ebc7a tempest-TestInstancesWithCinderVolumes-509314505 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a2e50e2-e51c-476d-8d68-db18dab520dd', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:21:56 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a Sep 23 00:21:56 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-490e6bb6-1bec-42fa-af9b-bdd220c703a5 req-458a283e-4dac-4fe8-95e9-c185817ebc7a tempest-TestInstancesWithCinderVolumes-509314505 None] attachment_update completed successfully. Sep 23 00:21:57 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a" returned: 0 in 0.811s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:57 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a Sep 23 00:21:57 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:57 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c.2f460177-6db9-4d3f-a1f8-c96e1e0ca94a" returned: 0 in 0.379s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-quobyte-2f460177-6db9-4d3f-a1f8-c96e1e0ca94a" released by "_delete_snapshot" :: held 3.304s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-quobyte-c78db2ae-703b-4b90-a765-7af618ccc48c" released by "delete_snapshot" :: held 3.416s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Creating offline snapshot b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 of volume 43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc99cdf7-d770-43a6-af0c-0135f5c46b88]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:58 devstack cinder-volume[87138]: DEBUG cinder.quota [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Created reservations ['21bb54ab-52a0-4490-86d4-0d7ee31c3cad', '0b40f71a-e5e5-45cf-967b-d3d1e473b1f4', 'be3dcbf3-7d4c-4a56-981f-ef95683e3e00', '908ca54e-5f42-4aad-acc9-7fb06f925acd', 'd4f0a891-ae5e-4bd1-adfc-bc88e26f460e'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:21:58 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b Sep 23 00:21:58 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Delete snapshot completed successfully. Sep 23 00:21:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-74d03cfa-bb9f-4afa-b7f3-075d04cc7f8c req-ef42d089-2885-4d66-be1e-89e918c5d815 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-2f460177-6db9-4d3f-a1f8-c96e1e0ca94a-delete_snapshot" released by "delete_snapshot" :: held 3.850s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:21:58 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b" returned: 0 in 0.603s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:58 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 1G Sep 23 00:21:58 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Acquiring lock "cinder-c78db2ae-703b-4b90-a765-7af618ccc48c-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-c78db2ae-703b-4b90-a765-7af618ccc48c-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Acquiring lock "cinder-quobyte-c78db2ae-703b-4b90-a765-7af618ccc48c" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:21:59 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-quobyte-c78db2ae-703b-4b90-a765-7af618ccc48c" acquired by "delete_volume" :: waited 0.046s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 1G" returned: 0 in 0.828s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43118dda-b682-461d-b331-1792b8b8124b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a846a-4ba0-4c52-baba-2dcbdf14d988]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:21:59 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43118dda-b682-461d-b331-1792b8b8124b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 Sep 23 00:21:59 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:59 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c Sep 23 00:21:59 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:21:59 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43118dda-b682-461d-b331-1792b8b8124b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" returned: 0 in 0.578s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:21:59 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 is being set with open permissions: ugo+rw Sep 23 00:21:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:00 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 Sep 23 00:22:00 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:00 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c" returned: 0 in 0.689s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:00 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c Sep 23 00:22:00 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:00 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" returned: 0 in 0.341s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:00 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.info Sep 23 00:22:00 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:00 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c78db2ae-703b-4b90-a765-7af618ccc48c" returned: 0 in 0.398s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-quobyte-c78db2ae-703b-4b90-a765-7af618ccc48c" released by "delete_volume" :: held 1.211s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG cinder.quota [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Created reservations ['c3a3f23b-a8d5-4a5a-a6ad-09b5ded302ed', '728cb0ff-194f-4325-8f8e-d0fb88d5e983', '07e62da4-fd25-4b7e-9e2d-4242d025a998', '9c30c817-a6bf-44be-8a69-3eba41fe5702', '1661046e-a215-43bb-8183-3ded6b6a8f19'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:00 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.info" returned: 0 in 0.533s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:00 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.info is being set with open permissions: ugo+rw Sep 23 00:22:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:00 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:00 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:01 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.info Sep 23 00:22:01 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:01 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.542s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:01 devstack cinder-volume[87138]: DEBUG cinder.manager [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Deleted volume successfully. Sep 23 00:22:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-91ebc957-efd1-4119-8a45-177b0a39e675 req-ee80b59b-3596-4290-bdae-6de4391ec510 tempest-VolumesSnapshotsTestJSON-758457529 None] Lock "cinder-c78db2ae-703b-4b90-a765-7af618ccc48c-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:01 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.info" returned: 0 in 0.699s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.755s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f2c84775-1337-4b44-98e5-7d0c4676c5ba tempest-VolumesSnapshotListTestJSON-2005516907 None] Create snapshot completed successfully Sep 23 00:22:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:02 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:02 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Creating offline snapshot 6a9e464e-817d-43c5-8ca7-a21418d5026c of volume 43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:22:03 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.477s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:03 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da29ede-f6d8-4e7d-a76b-1f76e55ab14a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:22:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:22:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:22:03 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 Sep 23 00:22:03 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:04 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" returned: 0 in 0.738s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43118dda-b682-461d-b331-1792b8b8124b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:04 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c 1G Sep 23 00:22:04 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:05 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c 1G" returned: 0 in 1.405s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:05 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c Sep 23 00:22:05 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:05 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c" returned: 0 in 0.530s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:06 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c is being set with open permissions: ugo+rw Sep 23 00:22:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:06 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c Sep 23 00:22:06 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:06 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c" returned: 0 in 0.431s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.554s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5d9e3049-5e22-4ebb-acc1-d633e87963ee tempest-VolumesSnapshotListTestJSON-2005516907 None] Create snapshot completed successfully Sep 23 00:22:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Creating offline snapshot 1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f of volume 43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:22:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e23942f-2974-410a-a6ae-f284705356d7]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:08 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c Sep 23 00:22:08 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:09 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c" returned: 0 in 1.052s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43118dda-b682-461d-b331-1792b8b8124b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:09 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f 1G Sep 23 00:22:09 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Flow 'volume_create_manager' (f966e15a-16ba-491b-9a92-1ac8c6ef8d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa84da5e-69d3-413b-b4ef-802c3fb24514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa84da5e-69d3-413b-b4ef-802c3fb24514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1655461279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24b61409e8e4c37a4151b3f8af5dd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:09Z,use_quota=True,user_id='0c76dc3f47a942acb0eaaf9a50cdb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9828bbf7-70cb-4696-97b5-2229b010f0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9828bbf7-70cb-4696-97b5-2229b010f0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21eb25-8cc2-4e6d-b83f-d37bebdb2a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed21eb25-8cc2-4e6d-b83f-d37bebdb2a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c', 'volume_name': 'volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6372c109-6e3e-424a-a6fa-0975046a2d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6372c109-6e3e-424a-a6fa-0975046a2d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd223f6-2e80-4dd6-a375-d07ed7caa1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:09 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Volume ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c', 'volume_size': 1} Sep 23 00:22:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:10 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f 1G" returned: 0 in 1.222s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:10 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f Sep 23 00:22:10 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Flow 'volume_create_manager' (3cedd469-2a98-4398-a47e-b902ee16314e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4223aae5-84e3-4faf-abb5-2bdaf7d4d68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4223aae5-84e3-4faf-abb5-2bdaf7d4d68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-745887768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8700e9d6-7900-4533-b143-2d3f549eac53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7f48e73ed564cdcba7e5d3d35a85177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:11Z,use_quota=True,user_id='abd56d29ca9343389f0534d19f47da37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4575f6e2-7458-4c2b-97d1-a4937650db36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4575f6e2-7458-4c2b-97d1-a4937650db36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce893bc-21e3-4c76-aa3f-df80ad6019a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce893bc-21e3-4c76-aa3f-df80ad6019a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8700e9d6-7900-4533-b143-2d3f549eac53', 'volume_name': 'volume-8700e9d6-7900-4533-b143-2d3f549eac53', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9816983-c119-483e-90cb-0b1d0d52a566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9816983-c119-483e-90cb-0b1d0d52a566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d799fa-4b84-41cf-afca-6a3c903134f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:11 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Volume 8700e9d6-7900-4533-b143-2d3f549eac53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8700e9d6-7900-4533-b143-2d3f549eac53', 'volume_size': 1} Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:11 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f" returned: 0 in 1.022s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:11 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f is being set with open permissions: ugo+rw Sep 23 00:22:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:11 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f Sep 23 00:22:11 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:12 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f" returned: 0 in 0.579s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.144s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.443s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1655461279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24b61409e8e4c37a4151b3f8af5dd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:09Z,use_quota=True,user_id='0c76dc3f47a942acb0eaaf9a50cdb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Creating volume ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:12 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:22:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:12 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c 1073741824 Sep 23 00:22:12 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:12 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-dac0eabc-e25f-465d-821d-e36d45e18f23 tempest-VolumesSnapshotListTestJSON-2005516907 None] Create snapshot completed successfully Sep 23 00:22:13 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c 1073741824" returned: 0 in 1.135s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:13 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c Sep 23 00:22:13 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:14 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c" returned: 0 in 0.581s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.630s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-745887768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8700e9d6-7900-4533-b143-2d3f549eac53,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7f48e73ed564cdcba7e5d3d35a85177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:11Z,use_quota=True,user_id='abd56d29ca9343389f0534d19f47da37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Creating volume 8700e9d6-7900-4533-b143-2d3f549eac53 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:14 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd223f6-2e80-4dd6-a375-d07ed7caa1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcdb30d-066d-41bb-9981-5043d1534834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:14 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Volume volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c (ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c): created successfully Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bcdb30d-066d-41bb-9981-5043d1534834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:14 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53 1073741824 Sep 23 00:22:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Flow 'volume_create_manager' (f966e15a-16ba-491b-9a92-1ac8c6ef8d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:14 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:14 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-502e87eb-4a1a-4965-a736-e5c5c3a2d112 tempest-AttachVolumeTestJSON-1546700317 None] Created volume successfully. Sep 23 00:22:15 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53 1073741824" returned: 0 in 1.149s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:15 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53 Sep 23 00:22:15 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-quobyte-1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:16 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Deleting offline snapshot 1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f of volume 43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] snapshot_file for this snap is: volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53" returned: 0 in 1.007s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9003a7d-42bb-4992-b349-5607c18b0b7a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3d799fa-4b84-41cf-afca-6a3c903134f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8700e9d6-7900-4533-b143-2d3f549eac53', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5578f978-0588-421e-9591-60e96d631fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:16 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Volume volume-8700e9d6-7900-4533-b143-2d3f549eac53 (8700e9d6-7900-4533-b143-2d3f549eac53): created successfully Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5578f978-0588-421e-9591-60e96d631fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Flow 'volume_create_manager' (3cedd469-2a98-4398-a47e-b902ee16314e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:16 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ac74ae68-e87b-4f75-bbdd-0ca1238a59ba tempest-VolumesTestJSON-880374697 None] Created volume successfully. Sep 23 00:22:16 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f Sep 23 00:22:16 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-29e9eb5b-b7de-471a-9d7c-0788a391b3f0 req-d5fdc4c6-34e5-40d3-9292-170945bd6419 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-29e9eb5b-b7de-471a-9d7c-0788a391b3f0 req-d5fdc4c6-34e5-40d3-9292-170945bd6419 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-29e9eb5b-b7de-471a-9d7c-0788a391b3f0 req-d5fdc4c6-34e5-40d3-9292-170945bd6419 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:17 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f" returned: 0 in 0.937s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43118dda-b682-461d-b331-1792b8b8124b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:17 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caaa548-6330-447e-855d-58159f633cc8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-29e9eb5b-b7de-471a-9d7c-0788a391b3f0 req-d5fdc4c6-34e5-40d3-9292-170945bd6419 tempest-AttachVolumeTestJSON-1546700317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75d76f61-1ba6-4bc5-bfef-aae323c568ed', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-29e9eb5b-b7de-471a-9d7c-0788a391b3f0 req-d5fdc4c6-34e5-40d3-9292-170945bd6419 tempest-AttachVolumeTestJSON-1546700317 None] attachment_update completed successfully. Sep 23 00:22:17 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c Sep 23 00:22:17 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Flow 'volume_create_manager' (0f492108-2c12-4895-9984-17a6264d94ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:18 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832890b9-b99e-4c8b-a953-191ec406f4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c" returned: 0 in 1.183s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43118dda-b682-461d-b331-1792b8b8124b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:18 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832890b9-b99e-4c8b-a953-191ec406f4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2054158418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9667780-f9a8-4838-841c-9b2f79478923,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7f48e73ed564cdcba7e5d3d35a85177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:18Z,use_quota=True,user_id='abd56d29ca9343389f0534d19f47da37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:18 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b06e58a-9a16-4b87-bfbe-7a5d50a650c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b06e58a-9a16-4b87-bfbe-7a5d50a650c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af277e4-0153-4f19-abfb-a2ddd2bca356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af277e4-0153-4f19-abfb-a2ddd2bca356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9667780-f9a8-4838-841c-9b2f79478923', 'volume_name': 'volume-b9667780-f9a8-4838-841c-9b2f79478923', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407537b1-1197-43e2-87a0-523a3a8703fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407537b1-1197-43e2-87a0-523a3a8703fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604323ef-ef7f-4670-91b2-a0bf8c411f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:18 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Volume b9667780-f9a8-4838-841c-9b2f79478923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9667780-f9a8-4838-841c-9b2f79478923', 'volume_size': 1} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2054158418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9667780-f9a8-4838-841c-9b2f79478923,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7f48e73ed564cdcba7e5d3d35a85177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:18Z,use_quota=True,user_id='abd56d29ca9343389f0534d19f47da37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Creating volume b9667780-f9a8-4838-841c-9b2f79478923 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:18 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:22:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:18 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923 1073741824 Sep 23 00:22:18 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f" returned: 0 in 0.873s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:19 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f Sep 23 00:22:19 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:19 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923 1073741824" returned: 0 in 1.087s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=90,cinder:INSERT=25,cinder:SELECT=105,cinder:DELETE=8 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=76,cinder:UPDATE=94,cinder:INSERT=29,cinder:DELETE=9 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:20 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923 Sep 23 00:22:20 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:20 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f" returned: 0 in 0.592s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f" released by "_delete_snapshot" :: held 3.878s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" released by "delete_snapshot" :: held 3.950s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:20 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923" returned: 0 in 0.546s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (604323ef-ef7f-4670-91b2-a0bf8c411f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9667780-f9a8-4838-841c-9b2f79478923', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92e55e0-f1cf-4265-bb07-69b45f877124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Created reservations ['58d3cf76-e563-44fb-b7e4-e54785da490e', '960b9716-ab20-42a4-ada2-e0aeb23771cb', 'd627e030-7ab0-48d7-9764-10d579cf626b', 'fc2b9c83-b2a7-41dc-9bcd-b08b3a0cb1da', 'dbc9d758-c238-41a6-8956-0e726981eb60'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:20 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Volume volume-b9667780-f9a8-4838-841c-9b2f79478923 (b9667780-f9a8-4838-841c-9b2f79478923): created successfully Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92e55e0-f1cf-4265-bb07-69b45f877124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Flow 'volume_create_manager' (0f492108-2c12-4895-9984-17a6264d94ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e1f2ff48-e0f6-42a5-a19b-0a2c1528a6eb tempest-VolumesTestJSON-880374697 None] Created volume successfully. Sep 23 00:22:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Delete snapshot completed successfully. Sep 23 00:22:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0a77798a-2f46-4f8e-8a96-80bce1ad0247 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-1fcf58ef-7bad-4abe-9850-bc00ed2d6e4f-delete_snapshot" released by "delete_snapshot" :: held 4.557s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-6a9e464e-817d-43c5-8ca7-a21418d5026c-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-6a9e464e-817d-43c5-8ca7-a21418d5026c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-quobyte-6a9e464e-817d-43c5-8ca7-a21418d5026c" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-6a9e464e-817d-43c5-8ca7-a21418d5026c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Deleting offline snapshot 6a9e464e-817d-43c5-8ca7-a21418d5026c of volume 43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] snapshot_file for this snap is: volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5747a92-e4fd-4336-a82c-f69433acc4c5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:21 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c Sep 23 00:22:21 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:22 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c" returned: 0 in 0.728s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43118dda-b682-461d-b331-1792b8b8124b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b555f2a-c89e-4545-a70d-20876a3791fa]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Flow 'volume_create_manager' (3fd5e679-da3f-4709-b839-caa1cfbe6fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b4a0a6-9851-451e-b436-45f7b68f443a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b4a0a6-9851-451e-b436-45f7b68f443a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1287634715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9221146-418f-42cf-a08c-7b00af7a36df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24b61409e8e4c37a4151b3f8af5dd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:22Z,use_quota=True,user_id='0c76dc3f47a942acb0eaaf9a50cdb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246a2866-8a5e-4668-b595-0003074afff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (246a2866-8a5e-4668-b595-0003074afff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7a1f61-eafb-48b4-ad00-49ed11f72e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:22 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7a1f61-eafb-48b4-ad00-49ed11f72e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9221146-418f-42cf-a08c-7b00af7a36df', 'volume_name': 'volume-b9221146-418f-42cf-a08c-7b00af7a36df', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:22 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0038935a-9357-4870-887e-79a634d70fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0038935a-9357-4870-887e-79a634d70fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e68837-af19-4811-a3b4-ec4d5f59f979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:22 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Volume b9221146-418f-42cf-a08c-7b00af7a36df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9221146-418f-42cf-a08c-7b00af7a36df', 'volume_size': 1} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1287634715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9221146-418f-42cf-a08c-7b00af7a36df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d24b61409e8e4c37a4151b3f8af5dd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:22Z,use_quota=True,user_id='0c76dc3f47a942acb0eaaf9a50cdb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Creating volume b9221146-418f-42cf-a08c-7b00af7a36df {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:22 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:22 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df 1073741824 Sep 23 00:22:22 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:22 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" returned: 0 in 0.656s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43118dda-b682-461d-b331-1792b8b8124b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:22 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c Sep 23 00:22:22 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Flow 'volume_create_manager' (c11557a8-65b6-4e74-ab4d-1f12717addfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57be3e82-de65-44da-ab0f-805a00b84578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57be3e82-de65-44da-ab0f-805a00b84578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-56016838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ca7183-399f-4f45-bd21-f85d531a8672,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7f48e73ed564cdcba7e5d3d35a85177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:23Z,use_quota=True,user_id='abd56d29ca9343389f0534d19f47da37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927a1281-3d73-4089-9906-7ad4165d29b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927a1281-3d73-4089-9906-7ad4165d29b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f52206c-a35e-4101-acba-a96ff283197b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f52206c-a35e-4101-acba-a96ff283197b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ca7183-399f-4f45-bd21-f85d531a8672', 'volume_name': 'volume-85ca7183-399f-4f45-bd21-f85d531a8672', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9e0c6a-d4e5-45d0-937b-418497090379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9e0c6a-d4e5-45d0-937b-418497090379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3a3f2a-d4d2-4db2-94ec-23992c54fea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Volume 85ca7183-399f-4f45-bd21-f85d531a8672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ca7183-399f-4f45-bd21-f85d531a8672', 'volume_size': 1} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:23 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df 1073741824" returned: 0 in 0.937s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:23 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df Sep 23 00:22:23 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:23 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c" returned: 0 in 0.786s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:23 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c Sep 23 00:22:23 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:23 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df" returned: 0 in 0.461s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-56016838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ca7183-399f-4f45-bd21-f85d531a8672,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a7f48e73ed564cdcba7e5d3d35a85177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:23Z,use_quota=True,user_id='abd56d29ca9343389f0534d19f47da37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Creating volume 85ca7183-399f-4f45-bd21-f85d531a8672 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:23 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e68837-af19-4811-a3b4-ec4d5f59f979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9221146-418f-42cf-a08c-7b00af7a36df', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1448e68-3b8d-4add-826a-e0a03417403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:23 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672 1073741824 Sep 23 00:22:23 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Volume volume-b9221146-418f-42cf-a08c-7b00af7a36df (b9221146-418f-42cf-a08c-7b00af7a36df): created successfully Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1448e68-3b8d-4add-826a-e0a03417403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Flow 'volume_create_manager' (3fd5e679-da3f-4709-b839-caa1cfbe6fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b7058f20-2119-4030-8a3f-7e9aa2e61617 tempest-AttachVolumeTestJSON-1546700317 None] Created volume successfully. Sep 23 00:22:24 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.6a9e464e-817d-43c5-8ca7-a21418d5026c" returned: 0 in 0.532s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-6a9e464e-817d-43c5-8ca7-a21418d5026c" released by "_delete_snapshot" :: held 2.893s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" released by "delete_snapshot" :: held 2.943s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Created reservations ['028713f5-2f7d-43d2-8cb4-15052c207bc4', '4b6f1a37-0607-4624-8ba1-84a42af6dacd', 'f88d3ac0-c6c9-40d5-a9e1-62f463df42bb', 'bfeb663d-58bf-4640-84b3-fd8e998f2ff7', 'f59ca4f2-49f4-4342-ba71-41e1fa061239'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Delete snapshot completed successfully. Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fe386ed4-6cdd-4b7e-8192-2e668a8a146f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-6a9e464e-817d-43c5-8ca7-a21418d5026c-delete_snapshot" released by "delete_snapshot" :: held 3.301s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-quobyte-b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Deleting offline snapshot b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 of volume 43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:22:24 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] snapshot_file for this snap is: volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672 1073741824" returned: 0 in 1.001s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7754af-8d3b-4340-983e-721abf70c195]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:25 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672 Sep 23 00:22:25 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:25 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 Sep 23 00:22:25 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:25 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672" returned: 0 in 0.454s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc3a3f2a-d4d2-4db2-94ec-23992c54fea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ca7183-399f-4f45-bd21-f85d531a8672', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3ade46-457e-4dc9-ad1c-bdbb2a02aac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Volume volume-85ca7183-399f-4f45-bd21-f85d531a8672 (85ca7183-399f-4f45-bd21-f85d531a8672): created successfully Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3ade46-457e-4dc9-ad1c-bdbb2a02aac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Flow 'volume_create_manager' (c11557a8-65b6-4e74-ab4d-1f12717addfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5d709c84-60a8-42ae-903b-dedf2b5df38e tempest-VolumesTestJSON-880374697 None] Created volume successfully. Sep 23 00:22:25 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" returned: 0 in 0.772s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43118dda-b682-461d-b331-1792b8b8124b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0d5815-cfac-4e59-9bd1-8e909e86ac55]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-effe2801-1821-4b54-9e9a-5b9d1a1ee371 req-87c66a46-e539-46b6-ba11-60535b5f9624 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-effe2801-1821-4b54-9e9a-5b9d1a1ee371 req-87c66a46-e539-46b6-ba11-60535b5f9624 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-effe2801-1821-4b54-9e9a-5b9d1a1ee371 req-87c66a46-e539-46b6-ba11-60535b5f9624 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:25 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b Sep 23 00:22:25 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-effe2801-1821-4b54-9e9a-5b9d1a1ee371 req-87c66a46-e539-46b6-ba11-60535b5f9624 tempest-AttachVolumeTestJSON-1546700317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-b9221146-418f-42cf-a08c-7b00af7a36df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb751582-c4a5-4825-9359-f12952b0bb2e', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-effe2801-1821-4b54-9e9a-5b9d1a1ee371 req-87c66a46-e539-46b6-ba11-60535b5f9624 tempest-AttachVolumeTestJSON-1546700317 None] attachment_update completed successfully. Sep 23 00:22:26 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b" returned: 0 in 0.693s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:26 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 Sep 23 00:22:26 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:27 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" returned: 0 in 0.801s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:27 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2 Sep 23 00:22:27 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:27 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b.b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" returned: 0 in 0.390s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2" released by "_delete_snapshot" :: held 2.913s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" released by "delete_snapshot" :: held 2.968s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Acquiring lock "cinder-85ca7183-399f-4f45-bd21-f85d531a8672-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Lock "cinder-85ca7183-399f-4f45-bd21-f85d531a8672-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Acquiring lock "cinder-quobyte-85ca7183-399f-4f45-bd21-f85d531a8672" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Created reservations ['3f9dbc66-2729-4979-83ae-39b16b2584dc', 'bd9ab8da-4f9c-46bb-beaa-85f48b3f80dd', '23e5b54b-0c80-4236-b1f4-bbb8677a69ea', 'c690befd-1df9-444c-a0b5-a6ae23bf89b4', '070e0df2-5c6d-4184-bdd7-e50434f7e9d0'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Lock "cinder-quobyte-85ca7183-399f-4f45-bd21-f85d531a8672" acquired by "delete_volume" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d6a741-f830-43d4-bebc-2bffbbd9f88b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:28 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Delete snapshot completed successfully. Sep 23 00:22:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-456d4ec8-3ee5-4c5c-927c-2cdb34c28561 tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-b6a4e92f-11ff-4574-ad72-8fe59d8cd0f2-delete_snapshot" released by "delete_snapshot" :: held 3.328s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:28 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672 Sep 23 00:22:28 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:28 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672" returned: 0 in 0.490s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:28 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672 Sep 23 00:22:28 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:28 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-85ca7183-399f-4f45-bd21-f85d531a8672" returned: 0 in 0.360s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Lock "cinder-quobyte-85ca7183-399f-4f45-bd21-f85d531a8672" released by "delete_volume" :: held 0.929s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:28 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Created reservations ['f36359b9-a63b-46c5-a8d0-3db6905c3775', '3f4c9bac-3885-4d80-ada0-1cb6d63a2df4', 'b09e3b05-7c66-42cf-97ae-a209391a68ac', 'be9db4e2-75ab-4be2-89fc-548da27a893f', '15553e36-d7f4-4205-99fd-07fb82e68f07'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:29 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:29 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-43118dda-b682-461d-b331-1792b8b8124b-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-385851bd-0d26-4e24-93a3-7942a800d912 req-a7964acd-088c-49da-be68-07d340e63801 tempest-AttachVolumeTestJSON-1546700317 None] Terminate volume connection completed successfully. Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-385851bd-0d26-4e24-93a3-7942a800d912 req-a7964acd-088c-49da-be68-07d340e63801 tempest-AttachVolumeTestJSON-1546700317 None] Deleting attachment 75d76f61-1ba6-4bc5-bfef-aae323c568ed. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-43118dda-b682-461d-b331-1792b8b8124b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95c18e8-9cb2-4fbc-9c26-7ba299bdbf90]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:29 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.411s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Deleted volume successfully. Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f1ff36d1-4f39-4651-a767-b697dc5511e4 tempest-VolumesTestJSON-880374697 None] Lock "cinder-85ca7183-399f-4f45-bd21-f85d531a8672-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:29 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b Sep 23 00:22:29 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:29 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b" returned: 0 in 0.550s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:29 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b Sep 23 00:22:29 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Acquiring lock "cinder-b9667780-f9a8-4838-841c-9b2f79478923-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Lock "cinder-b9667780-f9a8-4838-841c-9b2f79478923-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Acquiring lock "cinder-quobyte-b9667780-f9a8-4838-841c-9b2f79478923" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Lock "cinder-quobyte-b9667780-f9a8-4838-841c-9b2f79478923" acquired by "delete_volume" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87136ad-cd52-4ea8-b02b-492f0c162e5b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:30 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-43118dda-b682-461d-b331-1792b8b8124b" returned: 0 in 0.470s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-quobyte-43118dda-b682-461d-b331-1792b8b8124b" released by "delete_volume" :: held 1.135s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Created reservations ['171ccef2-b56a-49fa-a024-01748443ca07', 'bb3bfacd-bdd7-469f-bcc8-20ca35eb0a59', '08948fbf-ee0a-493b-8ac8-d6ef1266ca00', '7326cfe5-9cd5-4b0d-b13f-e35258c23c80', 'a7f15d40-e8bd-4d8f-94be-8944766c5ee7'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:30 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923 Sep 23 00:22:30 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:30 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:30 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:30 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-756c21ea-5dab-4fbe-b289-f2b6c7bc738c req-ffbfdb1c-979b-4cc9-ab3e-126c4603f64c tempest-AttachVolumeTestJSON-1546700317 None] Terminate volume connection completed successfully. Sep 23 00:22:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-756c21ea-5dab-4fbe-b289-f2b6c7bc738c req-ffbfdb1c-979b-4cc9-ab3e-126c4603f64c tempest-AttachVolumeTestJSON-1546700317 None] Deleting attachment cb751582-c4a5-4825-9359-f12952b0bb2e. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:22:30 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923" returned: 0 in 0.588s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:31 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923 Sep 23 00:22:31 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:31 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.420s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:31 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Deleted volume successfully. Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c0968aae-c10f-43ff-9c8d-bcb307f9fa1f tempest-VolumesSnapshotListTestJSON-2005516907 None] Lock "cinder-43118dda-b682-461d-b331-1792b8b8124b-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:31 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9667780-f9a8-4838-841c-9b2f79478923" returned: 0 in 0.349s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Lock "cinder-quobyte-b9667780-f9a8-4838-841c-9b2f79478923" released by "delete_volume" :: held 1.047s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Created reservations ['74a595b8-bb47-44b9-b652-22f417af5593', 'a68faa27-eb96-44be-85b2-2a4b32fd12ad', '090fc920-5f23-4055-ae5e-0abe1c725c95', 'ef461924-5d14-4ac4-86c5-e60e3a96fdc5', '980ea106-4659-41cb-a81d-901839316a51'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:31 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:31 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:31 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.320s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:31 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Deleted volume successfully. Sep 23 00:22:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a9c2506a-ffd6-43d3-b670-d26b7dd6b44b tempest-VolumesTestJSON-880374697 None] Lock "cinder-b9667780-f9a8-4838-841c-9b2f79478923-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Acquiring lock "cinder-8700e9d6-7900-4533-b143-2d3f549eac53-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Lock "cinder-8700e9d6-7900-4533-b143-2d3f549eac53-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Acquiring lock "cinder-quobyte-8700e9d6-7900-4533-b143-2d3f549eac53" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Lock "cinder-quobyte-8700e9d6-7900-4533-b143-2d3f549eac53" acquired by "delete_volume" :: waited 0.055s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:32 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e24d72-3b05-445d-931c-100f94fc42b2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:33 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53 Sep 23 00:22:33 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:33 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53" returned: 0 in 0.854s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:33 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53 Sep 23 00:22:33 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:34 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8700e9d6-7900-4533-b143-2d3f549eac53" returned: 0 in 0.531s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Lock "cinder-quobyte-8700e9d6-7900-4533-b143-2d3f549eac53" released by "delete_volume" :: held 1.568s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:34 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Created reservations ['8276fac4-c721-4059-9f30-3622fa308af6', 'e7c9ae4e-6368-41e5-ac65-94afe82c4534', '714580fc-0acc-47f4-9013-89973d25981b', '1c66d76d-6f59-40ce-a607-57cf0b7a1cd3', '7d41d6d3-592f-4104-b77e-95c8f6fcc399'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:34 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:34 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:35 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.562s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:35 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Deleted volume successfully. Sep 23 00:22:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-25e6ed0d-d5cb-42a1-b567-e85f9e8c6b0f tempest-VolumesTestJSON-880374697 None] Lock "cinder-8700e9d6-7900-4533-b143-2d3f549eac53-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "cinder-b9221146-418f-42cf-a08c-7b00af7a36df-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-b9221146-418f-42cf-a08c-7b00af7a36df-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "cinder-quobyte-b9221146-418f-42cf-a08c-7b00af7a36df" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-quobyte-b9221146-418f-42cf-a08c-7b00af7a36df" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:37 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[75da548e-6683-453a-84e6-255e2714089f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:38 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df Sep 23 00:22:38 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:38 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df" returned: 0 in 0.472s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:38 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df Sep 23 00:22:38 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:38 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b9221146-418f-42cf-a08c-7b00af7a36df" returned: 0 in 0.364s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-quobyte-b9221146-418f-42cf-a08c-7b00af7a36df" released by "delete_volume" :: held 0.914s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:38 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Created reservations ['32bb0bd4-09f6-456f-bd73-9ca78322bc65', '71fd88cb-f8b6-4a81-a2a2-648d9e9c090e', '02b5de1a-7510-441d-ad87-0f577e94473d', 'b3dd5de1-d825-4fab-852b-6c378839eb31', 'e0cf1084-5c97-435e-a5db-5b85c3126677'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:39 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:39 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:39 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.317s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:39 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Deleted volume successfully. Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4b82f5f6-9834-44aa-b142-62b46558bf7b tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-b9221146-418f-42cf-a08c-7b00af7a36df-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Flow 'volume_create_manager' (6375fefb-23a7-4656-aecc-4e875a0e3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f876edf4-ce5b-4fd6-b3f5-5c2263b066c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f876edf4-ce5b-4fd6-b3f5-5c2263b066c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1260866079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ee90c73d664010af7383da7dfc2b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:40Z,use_quota=True,user_id='9e8bd8bf48f041a9bd42e9dcab120209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bff9a95-dcdf-4ddd-b2f4-7a10af4b6a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bff9a95-dcdf-4ddd-b2f4-7a10af4b6a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04da6f0b-a9e4-46e5-b484-6ec3d4e32196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04da6f0b-a9e4-46e5-b484-6ec3d4e32196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b', 'volume_name': 'volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b', 'volume_size': 2}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d85009f-e724-461c-8a4e-620eceb5d083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d85009f-e724-461c-8a4e-620eceb5d083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bc5f59-6809-4f1b-a199-bc062835a155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:39 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Volume e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b', 'volume_size': 2} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1260866079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ee90c73d664010af7383da7dfc2b1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:40Z,use_quota=True,user_id='9e8bd8bf48f041a9bd42e9dcab120209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Creating volume e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:39 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:22:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b 2147483648 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:39 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b 2147483648 Sep 23 00:22:39 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "cinder-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "cinder-quobyte-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-quobyte-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c" acquired by "delete_volume" :: waited 0.031s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:40 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[137f66be-9b8e-4787-a42c-a1dc0942323b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:40 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c Sep 23 00:22:40 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:40 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b 2147483648" returned: 0 in 0.839s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:40 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b Sep 23 00:22:40 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:41 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c" returned: 0 in 0.661s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:41 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c Sep 23 00:22:41 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:41 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" returned: 0 in 0.397s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21bc5f59-6809-4f1b-a199-bc062835a155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b', 'volume_size': 2}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700a7384-67a7-424c-85a8-4bb6d0f6c093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Volume volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b (e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b): created successfully Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (700a7384-67a7-424c-85a8-4bb6d0f6c093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Flow 'volume_create_manager' (6375fefb-23a7-4656-aecc-4e875a0e3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:41 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-43a78c68-89ed-48df-8b92-fe5b1ba814c3 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Created volume successfully. Sep 23 00:22:41 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c" returned: 0 in 0.449s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-quobyte-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c" released by "delete_volume" :: held 1.185s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Created reservations ['4ebe82f7-21f7-46dc-be0f-2f13e025a498', '90459d28-beff-4ec4-bd35-4963909e0250', '0bda5a31-4403-4156-8c4b-1b5e27306162', 'eee85deb-d674-4208-9b01-596be08ae439', '3b5cb808-d994-4388-8716-ba2bc310c051'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:41 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:41 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:42 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.411s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:42 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Deleted volume successfully. Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d693ef2e-0b0a-43b2-b5cb-21227c73a87d tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-ee3cb8a8-d9d9-49c0-930b-e9e02930aa4c-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Creating offline snapshot f0b230b8-38d1-4b1f-934a-d7c044520396 of volume e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[becc8c3e-ac34-4baf-84fa-2a81fb8d0a48]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-fc27b612-8906-454d-a8d1-e61c57cd8d6f req-011bd05d-f345-420f-9710-bbf7147ceae1 tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:42 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b Sep 23 00:22:42 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "cinder-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "cinder-quobyte-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-quobyte-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e86b021-1151-4a50-bf04-e6aebb891399]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:43 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:43 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 Sep 23 00:22:43 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" returned: 0 in 0.702s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 2G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:43 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 2G Sep 23 00:22:43 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:43 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865" returned: 0 in 0.580s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:43 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865 Sep 23 00:22:43 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:43 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 2G" returned: 0 in 0.666s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:43 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 Sep 23 00:22:43 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865" returned: 0 in 0.436s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-quobyte-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865" released by "delete_volume" :: held 1.100s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Created reservations ['20f25f4d-e7f4-4892-9bb4-2fcc65813f1f', '26a7dbbd-30dc-4d07-a6e3-edc3e934ea0d', 'b2e82f66-85a7-403c-8851-ab28d6877bc9', '1fc17a3f-3401-4841-a4b6-9922985eb99b', 'f6ff4a13-abb0-468b-abeb-e5da3b9c5878'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:44 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396" returned: 0 in 0.540s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 is being set with open permissions: ugo+rw Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 Sep 23 00:22:44 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:44 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396" returned: 0 in 0.334s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.455s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:44 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Deleted volume successfully. Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3d8ca3c4-cc46-49c6-9492-484a78196cd5 tempest-AttachVolumeTestJSON-1546700317 None] Lock "cinder-0c4b85c9-a3d9-42b8-8eec-3b236b1d5865-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:44 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.info Sep 23 00:22:44 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:45 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.info" returned: 0 in 0.507s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:45 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.info is being set with open permissions: ugo+rw Sep 23 00:22:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:45 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.info Sep 23 00:22:45 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:45 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.info" returned: 0 in 0.467s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.413s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-fc27b612-8906-454d-a8d1-e61c57cd8d6f req-011bd05d-f345-420f-9710-bbf7147ceae1 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.293s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-fc27b612-8906-454d-a8d1-e61c57cd8d6f req-011bd05d-f345-420f-9710-bbf7147ceae1 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:45 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2111a58e-5a94-4b51-a0ae-8b2880da0ac5 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Create snapshot completed successfully Sep 23 00:22:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-fc27b612-8906-454d-a8d1-e61c57cd8d6f req-011bd05d-f345-420f-9710-bbf7147ceae1 tempest-TestInstancesWithCinderVolumes-509314505 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0470b9be-ee43-461e-8061-7cc7d59b892c', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-fc27b612-8906-454d-a8d1-e61c57cd8d6f req-011bd05d-f345-420f-9710-bbf7147ceae1 tempest-TestInstancesWithCinderVolumes-509314505 None] attachment_update completed successfully. Sep 23 00:22:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Acquiring lock "cinder-f0b230b8-38d1-4b1f-934a-d7c044520396-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-f0b230b8-38d1-4b1f-934a-d7c044520396-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Acquiring lock "cinder-quobyte-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-quobyte-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Acquiring lock "cinder-quobyte-f0b230b8-38d1-4b1f-934a-d7c044520396" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-quobyte-f0b230b8-38d1-4b1f-934a-d7c044520396" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Deleting offline snapshot f0b230b8-38d1-4b1f-934a-d7c044520396 of volume e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] snapshot_file for this snap is: volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd50577-d95a-4eeb-b16a-125e3a384549]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:47 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 Sep 23 00:22:47 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:47 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396" returned: 0 in 0.694s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd22a98d-8c5d-4bfa-aa46-81b98f204614]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:48 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b Sep 23 00:22:48 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:48 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" returned: 0 in 0.654s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:48 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 Sep 23 00:22:48 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:49 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396" returned: 0 in 0.706s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:49 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396 Sep 23 00:22:49 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-18372649-d602-4080-9284-06f9b9e114a1 req-74175a0b-096e-46ef-97b4-3b1f40e4d30a tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-18372649-d602-4080-9284-06f9b9e114a1 req-74175a0b-096e-46ef-97b4-3b1f40e4d30a tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:49 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-18372649-d602-4080-9284-06f9b9e114a1 req-74175a0b-096e-46ef-97b4-3b1f40e4d30a tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b.f0b230b8-38d1-4b1f-934a-d7c044520396" returned: 0 in 0.397s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-quobyte-f0b230b8-38d1-4b1f-934a-d7c044520396" released by "_delete_snapshot" :: held 2.692s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-quobyte-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" released by "delete_snapshot" :: held 2.733s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-18372649-d602-4080-9284-06f9b9e114a1 req-74175a0b-096e-46ef-97b4-3b1f40e4d30a tempest-TestInstancesWithCinderVolumes-509314505 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-b059badc-c8cb-4129-882f-14e8e708dc88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c213727-ec97-4f32-8e35-91bf2c2af908', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:22:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-18372649-d602-4080-9284-06f9b9e114a1 req-74175a0b-096e-46ef-97b4-3b1f40e4d30a tempest-TestInstancesWithCinderVolumes-509314505 None] attachment_update completed successfully. Sep 23 00:22:50 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Created reservations ['9ae27878-fde7-4730-93aa-3ee5820612b9', '549923c9-99e1-4439-b4d9-3fbbc260467e', '38b2985c-d941-46ce-8ceb-5ef629730b9d', '4c41cf9c-d1c6-412f-a1a5-f3984d3f28f1', '749a3821-a909-43b7-bb2b-deed16d396e0'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:50 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Delete snapshot completed successfully. Sep 23 00:22:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-23ff62bf-9ca0-40a3-81b2-49300aeada30 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-f0b230b8-38d1-4b1f-934a-d7c044520396-delete_snapshot" released by "delete_snapshot" :: held 3.122s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Acquiring lock "cinder-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Acquiring lock "cinder-quobyte-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-quobyte-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:50 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e85c54-e831-4b91-8f58-ce1723441469]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:51 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b Sep 23 00:22:51 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:51 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" returned: 0 in 0.585s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:51 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b Sep 23 00:22:51 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:52 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" returned: 0 in 0.715s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-quobyte-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b" released by "delete_volume" :: held 1.413s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Created reservations ['18fe5ecc-dfbc-49dd-a53f-a44d2223747b', '51ee25af-d6f8-4aab-a45c-f3603ccea026', 'a6d682a3-4334-4728-b0c9-ccf68b0523ec', 'e1760f19-2c74-44d3-858e-c7f59fd14cb9', 'f7de3fda-b657-4c6e-816d-1987c6c5c52f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:52 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:22:52 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:52 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.413s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:22:52 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Deleted volume successfully. Sep 23 00:22:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-399e44e8-5ef9-4fec-b2be-ed3a9560b509 tempest-VolumesSnapshotNegativeTestJSON-1453968601 None] Lock "cinder-e010cd82-00bc-4ef4-8b2d-0ddeb839cb9b-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:22:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-098a74ce-70c8-4f04-89bf-335d220c9d8c tempest-GroupsV314Test-1214682998 None] Group tempest-GroupsV314Test-Group-1155371076: creating Sep 23 00:22:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-098a74ce-70c8-4f04-89bf-335d220c9d8c tempest-GroupsV314Test-1214682998 None] Group tempest-GroupsV314Test-Group-1155371076: created successfully Sep 23 00:22:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-098a74ce-70c8-4f04-89bf-335d220c9d8c tempest-GroupsV314Test-1214682998 None] Create group completed successfully. Sep 23 00:22:55 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:22:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Flow 'volume_create_manager' (7b62c24e-24b0-48ab-8122-1f4835509c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739f1714-ae37-4834-bbd4-6c57cda8b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739f1714-ae37-4834-bbd4-6c57cda8b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2112328874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d43d82d-3f40-4ebb-88ab-9df57988730d,host='devstack@QuobyteHD#QuobyteHD',id=6a4522e7-46d8-4e40-b8fd-f64974c99fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c47c25b54c64728ba1a9f5e71f797d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:56Z,use_quota=True,user_id='c1f69a2de163468b9a11bf968f992c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87162b67-f606-4094-907e-f122750f3492),volume_type_id=87162b67-f606-4094-907e-f122750f3492)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689a7389-9ee2-4a0f-ab0f-8cb9df780bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689a7389-9ee2-4a0f-ab0f-8cb9df780bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac664348-d884-4e07-9390-1b7b40fbe2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac664348-d884-4e07-9390-1b7b40fbe2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4522e7-46d8-4e40-b8fd-f64974c99fba', 'volume_name': 'volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4151fe-8a94-46ff-a42b-95fcf8928442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc4151fe-8a94-46ff-a42b-95fcf8928442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c48e06-d683-4b59-aafd-c48d6c46b1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:56 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Volume 6a4522e7-46d8-4e40-b8fd-f64974c99fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba', 'volume_size': 1} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d43d82d-3f40-4ebb-88ab-9df57988730d,created_at=2026-09-22T22:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2112328874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d43d82d-3f40-4ebb-88ab-9df57988730d,host='devstack@QuobyteHD#QuobyteHD',id=6a4522e7-46d8-4e40-b8fd-f64974c99fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c47c25b54c64728ba1a9f5e71f797d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:22:56Z,use_quota=True,user_id='c1f69a2de163468b9a11bf968f992c10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87162b67-f606-4094-907e-f122750f3492),volume_type_id=87162b67-f606-4094-907e-f122750f3492)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Creating volume 6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:22:56 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:56 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba 1073741824 Sep 23 00:22:56 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:56 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba 1073741824" returned: 0 in 0.889s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:57 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba Sep 23 00:22:57 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:22:57 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 23 00:22:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba" returned: 0 in 0.424s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:22:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:22:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:22:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c48e06-d683-4b59-aafd-c48d6c46b1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993db8ef-b2ff-490f-a2c0-5c9ebb252ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:22:57 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Volume volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba (6a4522e7-46d8-4e40-b8fd-f64974c99fba): created successfully Sep 23 00:22:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993db8ef-b2ff-490f-a2c0-5c9ebb252ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:22:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Flow 'volume_create_manager' (7b62c24e-24b0-48ab-8122-1f4835509c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:22:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2303a506-3c8f-4757-a39a-89737e9b2d07 tempest-GroupsV314Test-1214682998 None] Created volume successfully. Sep 23 00:22:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-8349e5c5-9b03-4909-837b-56a55ee92628 req-29e1f91b-871a-4b00-bc4f-58a9f913f137 tempest-TestInstancesWithCinderVolumes-509314505 None] Terminate volume connection completed successfully. Sep 23 00:22:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-8349e5c5-9b03-4909-837b-56a55ee92628 req-29e1f91b-871a-4b00-bc4f-58a9f913f137 tempest-TestInstancesWithCinderVolumes-509314505 None] Deleting attachment 0470b9be-ee43-461e-8061-7cc7d59b892c. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:22:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "cinder-286cfd93-d4c3-4a62-9b72-20ddd6075eeb-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-286cfd93-d4c3-4a62-9b72-20ddd6075eeb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "cinder-quobyte-286cfd93-d4c3-4a62-9b72-20ddd6075eeb" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:22:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-quobyte-286cfd93-d4c3-4a62-9b72-20ddd6075eeb" acquired by "delete_volume" :: waited 0.046s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:22:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a7ca5-c76f-4a0e-9cda-d8c7e7062eb7]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:22:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:22:59 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb Sep 23 00:22:59 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:00 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Cloning volume 6a4522e7-46d8-4e40-b8fd-f64974c99fba to volume cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 Sep 23 00:23:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Creating offline snapshot 651abbc6-a09c-4e4c-9d8a-fecc54b3447e of volume 6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:23:00 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e4e067-3f8d-4bae-adca-4d3131243d35]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:00 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb" returned: 0 in 1.065s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:00 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb Sep 23 00:23:00 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:00 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba Sep 23 00:23:00 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:01 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-286cfd93-d4c3-4a62-9b72-20ddd6075eeb" returned: 0 in 0.734s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:01 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba" returned: 0 in 0.843s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-quobyte-286cfd93-d4c3-4a62-9b72-20ddd6075eeb" released by "delete_volume" :: held 1.922s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:01 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e 1G Sep 23 00:23:01 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:01 devstack cinder-volume[87138]: WARNING cinder.quota [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-658725145-357502099 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-658725145-357502099, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:01 devstack cinder-volume[87138]: WARNING cinder.quota [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-658725145-357502099 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-658725145-357502099, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Created reservations ['74f1bba3-59ed-46da-b25a-4c54b11e7b37', '16465be7-9b86-4b71-97ca-c936edf0db9b', '8587783e-7b13-4ebe-ad1e-dcb0100ff94e', 'c2b2550c-7f70-4b8b-9d88-26f7dacb6cb4', '21016e3c-dbb8-4648-9364-b7438e27f21d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:01 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:23:01 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:01 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.547s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:01 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Deleted volume successfully. Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0d01912e-e756-41b8-9cc2-c35e1f5fceb7 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-286cfd93-d4c3-4a62-9b72-20ddd6075eeb-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:02 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e 1G" returned: 0 in 0.999s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:02 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e Sep 23 00:23:02 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:02 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e" returned: 0 in 0.724s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:02 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:23:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:02 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:23:02 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:02 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e Sep 23 00:23:02 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:03 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.542s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:23:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:23:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:23:03 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e" returned: 0 in 0.651s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:03 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.info Sep 23 00:23:03 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:04 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.info" returned: 0 in 0.510s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:04 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:04 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.info Sep 23 00:23:04 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:04 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.info" returned: 0 in 0.574s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Acquiring lock "cinder-quobyte-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Lock "cinder-quobyte-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] snapshot: 651abbc6-a09c-4e4c-9d8a-fecc54b3447e, volume: cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[74860089-0fb7-472e-9f3d-e035145ce832]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:05 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e Sep 23 00:23:05 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:05 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e" returned: 0 in 0.767s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:23:05 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d8629c-9a39-42c1-bd68-f0c5c46cd794]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:05 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba Sep 23 00:23:05 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-4438b1bc-3bac-4ae3-ae40-94defc18901d req-148715bc-89d7-4c8e-9498-01f2d94fa3b2 tempest-TestInstancesWithCinderVolumes-509314505 None] Terminate volume connection completed successfully. Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-4438b1bc-3bac-4ae3-ae40-94defc18901d req-148715bc-89d7-4c8e-9498-01f2d94fa3b2 tempest-TestInstancesWithCinderVolumes-509314505 None] Deleting attachment 5c213727-ec97-4f32-8e35-91bf2c2af908. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:23:06 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba" returned: 0 in 0.648s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:06 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 Sep 23 00:23:06 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "cinder-b059badc-c8cb-4129-882f-14e8e708dc88-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-b059badc-c8cb-4129-882f-14e8e708dc88-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "cinder-quobyte-b059badc-c8cb-4129-882f-14e8e708dc88" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-quobyte-b059badc-c8cb-4129-882f-14e8e708dc88" acquired by "delete_volume" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:07 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7029723f-22e6-4ca3-90c1-863f8480d600]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:07 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88 Sep 23 00:23:07 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:08 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88" returned: 0 in 1.393s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:08 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88 Sep 23 00:23:08 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:09 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b059badc-c8cb-4129-882f-14e8e708dc88" returned: 0 in 0.919s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-quobyte-b059badc-c8cb-4129-882f-14e8e708dc88" released by "delete_volume" :: held 2.408s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:09 devstack cinder-volume[87138]: WARNING cinder.quota [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-803106453-1077241851 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-803106453-1077241851, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:09 devstack cinder-volume[87138]: WARNING cinder.quota [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-803106453-1077241851 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-803106453-1077241851, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:09 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Created reservations ['9eb7a913-a6dd-4569-b9e0-a3a25d04d9d9', 'd0435d98-4385-4176-b56d-5181178b30c1', '73188b09-a0d9-477e-ae84-4ee2cf159cfe', '8f6ac6fc-a0a5-4d5f-b54a-82ecc038c1c5', 'a678d59d-85a6-4f7d-9c3e-0fd1911d7fd5'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:10 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:23:10 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:11 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.812s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:11 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:11 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Deleted volume successfully. Sep 23 00:23:11 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1bba4e18-fd31-432a-96ee-e373254c8910 tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-b059badc-c8cb-4129-882f-14e8e708dc88-delete_volume" released by "delete_volume" :: held 4.371s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:17 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" returned: 0 in 11.469s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:17 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba, size 1024.00 MB, duration 11.47 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:23:17 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Converted 1024.00 MB image at 89.27 MB/s Sep 23 00:23:17 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:23:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:17 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 Sep 23 00:23:17 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:18 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" returned: 0 in 0.362s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Lock "cinder-quobyte-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" released by "_copy_volume_from_snapshot" :: held 13.415s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Acquiring lock "cinder-quobyte-651abbc6-a09c-4e4c-9d8a-fecc54b3447e" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Lock "cinder-quobyte-651abbc6-a09c-4e4c-9d8a-fecc54b3447e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Deleting offline snapshot 651abbc6-a09c-4e4c-9d8a-fecc54b3447e of volume 6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] snapshot_file for this snap is: volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[780914d7-4a23-43cd-9377-f6d11a660575]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:18 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e Sep 23 00:23:18 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:18 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e" returned: 0 in 0.567s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3856b02-3294-42e3-9d07-0969b0a10028]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:19 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba Sep 23 00:23:19 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:19 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba" returned: 0 in 0.757s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:19 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e Sep 23 00:23:19 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:20 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e" returned: 0 in 0.549s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:20 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e Sep 23 00:23:20 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:20 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba.651abbc6-a09c-4e4c-9d8a-fecc54b3447e" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Lock "cinder-quobyte-651abbc6-a09c-4e4c-9d8a-fecc54b3447e" released by "_delete_snapshot" :: held 2.362s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=119,cinder:INSERT=34,cinder:UPDATE=147,cinder:DELETE=9 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=135,cinder:INSERT=44,cinder:UPDATE=132,cinder:DELETE=7 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.545s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-20026eb6-84db-4a58-90ea-b0b88eb0baa1 tempest-GroupsV314Test-1214682998 None] Create group from source-group-0d43d82d-3f40-4ebb-88ab-9df57988730d completed successfully. Sep 23 00:23:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Acquiring lock "cinder-quobyte-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Lock "cinder-quobyte-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:22 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ec8882-da79-4ed6-9cb8-30ec81f38d8c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:23 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 Sep 23 00:23:23 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:23 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" returned: 0 in 0.756s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:23 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9 Sep 23 00:23:23 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:24 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" returned: 0 in 0.522s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Lock "cinder-quobyte-cd33f24c-44c4-4dc5-a4aa-1e4065dcb8f9" released by "delete_volume" :: held 1.409s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Created reservations ['73f3e2e9-0291-4b75-8095-f4721734a8dc'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:24 devstack cinder-volume[87138]: WARNING cinder.quota [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-701094845 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-701094845, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:24 devstack cinder-volume[87138]: WARNING cinder.quota [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-701094845 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-701094845, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Created reservations ['f24875a3-0d0f-4638-abfe-9987fb5a29e2', 'a642f79c-450b-4ab1-8786-221d97a7afe0', '48f29441-77c7-4514-b894-c611b92cfb1a', '5b1be0c1-e384-40ea-acb1-53e4667fc8dc', '19e2ee59-af2d-42f2-890f-61626044a199'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:24 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:23:24 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:25 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.536s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:25 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-24c4587b-10b3-4bda-90a2-d925c99b6d94 tempest-GroupsV314Test-1214682998 None] Delete group completed successfully. Sep 23 00:23:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Acquiring lock "cinder-quobyte-6a4522e7-46d8-4e40-b8fd-f64974c99fba" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Lock "cinder-quobyte-6a4522e7-46d8-4e40-b8fd-f64974c99fba" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:26 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81964d9-8fce-421d-9bf6-17cb143d9bc0]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:26 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba Sep 23 00:23:26 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:26 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba" returned: 0 in 0.705s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:27 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba Sep 23 00:23:27 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:27 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6a4522e7-46d8-4e40-b8fd-f64974c99fba" returned: 0 in 0.451s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Lock "cinder-quobyte-6a4522e7-46d8-4e40-b8fd-f64974c99fba" released by "delete_volume" :: held 1.309s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:27 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Created reservations ['8bb12dfe-8001-4e0f-923c-6a2221e869a3'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:27 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Created reservations ['dfefed27-3257-4c50-82e3-c8654af1cbc1', '7fc0aadb-0912-410d-95f3-039bc6271579', '15986abf-f4d7-45f5-8103-c7406f30fbf7', 'c85e8bd0-2be3-44a6-856b-87a04e0dd0ae', '658ce5c6-4dfe-4ce8-bb4f-7172f37fd877'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:28 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:23:28 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:28 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.405s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:28 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:28 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8dedb938-1ea1-4b1e-bd9d-cbf10381dd51 tempest-GroupsV314Test-1214682998 None] Delete group completed successfully. Sep 23 00:23:34 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-c5ae0d77-7933-4d4a-ae6f-816a1410066f req-fa2fb5b4-3a4d-4f4b-91a6-e807f570dfd1 tempest-TestInstancesWithCinderVolumes-509314505 None] Terminate volume connection completed successfully. Sep 23 00:23:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-c5ae0d77-7933-4d4a-ae6f-816a1410066f req-fa2fb5b4-3a4d-4f4b-91a6-e807f570dfd1 tempest-TestInstancesWithCinderVolumes-509314505 None] Deleting attachment 8a2e50e2-e51c-476d-8d68-db18dab520dd. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:23:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "cinder-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "cinder-quobyte-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:23:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-quobyte-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00" acquired by "delete_volume" :: waited 0.026s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:23:35 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e769d2a-3e59-4bbe-8b1e-93e1b02cf602]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:23:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:36 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 Sep 23 00:23:36 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:36 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00" returned: 0 in 0.900s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:36 devstack sudo[97554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00 Sep 23 00:23:36 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:37 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00" returned: 0 in 0.463s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-quobyte-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00" released by "delete_volume" :: held 1.457s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:37 devstack cinder-volume[87138]: WARNING cinder.quota [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-333865235-1220540023 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-333865235-1220540023, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:37 devstack cinder-volume[87138]: WARNING cinder.quota [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-333865235-1220540023 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-333865235-1220540023, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:23:37 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Created reservations ['c93c8763-3bae-49bc-bcdd-8194f3cf74a7', '440ed937-f98f-4933-8698-1324a5357e71', '44383005-3e40-4ca4-b400-a5f6649fbaa9', '7cd8e5c6-6c59-40f7-be67-f9975c9bc18b', 'b97d5a46-012e-4150-a18c-d2710d01fd4c'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:23:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:23:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:23:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:23:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:23:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:23:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:23:37 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:23:37 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:23:38 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 23 00:23:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.650s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:23:38 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:23:38 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Deleted volume successfully. Sep 23 00:23:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-95c083c4-f0b7-4310-be39-ddb77ac0e9ac tempest-TestInstancesWithCinderVolumes-509314505 None] Lock "cinder-6f6dfbdb-06cd-4eff-b01e-0be2d98b8b00-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:23:47 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=35,cinder:SELECT=25,cinder:INSERT=8 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:23:48 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=33,cinder:SELECT=29,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:02 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:24:02 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:03 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.606s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:24:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:24:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Flow 'volume_create_manager' (376558c2-5b9e-4af2-a8a4-f1374a8f30af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dd5f58-a8b0-43d4-8db2-736c9af4ca90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dd5f58-a8b0-43d4-8db2-736c9af4ca90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1756426739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734d51da-edf5-485a-8c77-154759b2bd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85125ba936bd4d00b9f81dd35bdd9913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:24Z,use_quota=True,user_id='f780627221c24f87af0af056a14baeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa60694c-76f0-42d7-b216-ef41ad4c1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa60694c-76f0-42d7-b216-ef41ad4c1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f23be54-9d5f-4258-af43-6cdbf549aab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f23be54-9d5f-4258-af43-6cdbf549aab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734d51da-edf5-485a-8c77-154759b2bd55', 'volume_name': 'volume-734d51da-edf5-485a-8c77-154759b2bd55', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63fa9b6-e513-41d1-84a4-e17f9ace9af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63fa9b6-e513-41d1-84a4-e17f9ace9af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf8c182-5e84-443e-abd8-85c54ce72fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Volume 734d51da-edf5-485a-8c77-154759b2bd55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734d51da-edf5-485a-8c77-154759b2bd55', 'volume_size': 1} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1756426739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734d51da-edf5-485a-8c77-154759b2bd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85125ba936bd4d00b9f81dd35bdd9913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:24Z,use_quota=True,user_id='f780627221c24f87af0af056a14baeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Creating volume 734d51da-edf5-485a-8c77-154759b2bd55 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:24 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:24:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:24 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55 1073741824 Sep 23 00:24:24 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:25 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55 1073741824" returned: 0 in 1.144s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:25 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55 Sep 23 00:24:25 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:26 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55" returned: 0 in 0.393s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf8c182-5e84-443e-abd8-85c54ce72fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734d51da-edf5-485a-8c77-154759b2bd55', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1174ef-8a22-4650-8134-c08edc1ed4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Volume volume-734d51da-edf5-485a-8c77-154759b2bd55 (734d51da-edf5-485a-8c77-154759b2bd55): created successfully Sep 23 00:24:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1174ef-8a22-4650-8134-c08edc1ed4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Flow 'volume_create_manager' (376558c2-5b9e-4af2-a8a4-f1374a8f30af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-70c1966d-d5c3-47dd-a28b-1feb6f8628c4 tempest-AttachVolumeNegativeTest-2043665308 None] Created volume successfully. Sep 23 00:24:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-82382b28-ef47-412e-9855-ba69bc4fae65 req-d685182e-2f8a-402a-87f3-fa7081570e40 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-82382b28-ef47-412e-9855-ba69bc4fae65 req-d685182e-2f8a-402a-87f3-fa7081570e40 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-82382b28-ef47-412e-9855-ba69bc4fae65 req-d685182e-2f8a-402a-87f3-fa7081570e40 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-82382b28-ef47-412e-9855-ba69bc4fae65 req-d685182e-2f8a-402a-87f3-fa7081570e40 tempest-AttachVolumeNegativeTest-2043665308 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-734d51da-edf5-485a-8c77-154759b2bd55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '060aa7da-a8b6-46b3-a816-187efbf97880', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:24:28 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-82382b28-ef47-412e-9855-ba69bc4fae65 req-d685182e-2f8a-402a-87f3-fa7081570e40 tempest-AttachVolumeNegativeTest-2043665308 None] attachment_update completed successfully. Sep 23 00:24:38 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:38 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Flow 'volume_create_manager' (ebf15401-057f-4f01-bd36-defb08ac21aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff117e1-0a41-4563-9bdb-0c0974582bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff117e1-0a41-4563-9bdb-0c0974582bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1052663628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced1dddf-9e67-4d76-9365-3b258ad7fa55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e43c06aa9140fca71f26b8e7a42925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:40Z,use_quota=True,user_id='c77c7aaf126b4ab3a957814aa6e18a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64c98f9-bdf3-4872-9fde-f8ff24c3390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64c98f9-bdf3-4872-9fde-f8ff24c3390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d58205-2ce3-45e0-aa0b-7a79ebfe46d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d58205-2ce3-45e0-aa0b-7a79ebfe46d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ced1dddf-9e67-4d76-9365-3b258ad7fa55', 'volume_name': 'volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d261fc51-1af2-4e79-8c5b-36040edf2ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d261fc51-1af2-4e79-8c5b-36040edf2ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d005c1f8-6d41-4c02-b411-13bf20ad27b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:40 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Volume ced1dddf-9e67-4d76-9365-3b258ad7fa55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55', 'volume_size': 1} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1052663628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced1dddf-9e67-4d76-9365-3b258ad7fa55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e43c06aa9140fca71f26b8e7a42925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:40Z,use_quota=True,user_id='c77c7aaf126b4ab3a957814aa6e18a06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Creating volume ced1dddf-9e67-4d76-9365-3b258ad7fa55 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:40 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:24:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:40 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 1073741824 Sep 23 00:24:40 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 1073741824" returned: 0 in 0.894s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:41 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 Sep 23 00:24:41 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Flow 'volume_create_manager' (0a7b098b-a66c-4b2e-a654-ebd4ccbda9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b59abc-19af-4ba3-aea2-726d47d59e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b59abc-19af-4ba3-aea2-726d47d59e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1091692881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49baf7e5-1695-4d45-844b-6a493cb2c30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07644944192844ad9a6df8005457cb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:41Z,use_quota=True,user_id='67f44409bd904ae0b84ffc300df63c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7867b6de-8eec-4a0d-82af-fe367a4005c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7867b6de-8eec-4a0d-82af-fe367a4005c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae63aaf-9e79-4f7d-8ca3-e4c1f284a7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae63aaf-9e79-4f7d-8ca3-e4c1f284a7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49baf7e5-1695-4d45-844b-6a493cb2c30d', 'volume_name': 'volume-49baf7e5-1695-4d45-844b-6a493cb2c30d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f56312e-df14-47ff-850e-72cec7aed138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f56312e-df14-47ff-850e-72cec7aed138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fa55be-a915-48a7-b26c-413796b16caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Volume 49baf7e5-1695-4d45-844b-6a493cb2c30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49baf7e5-1695-4d45-844b-6a493cb2c30d', 'volume_size': 1} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:41 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55" returned: 0 in 0.505s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1091692881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49baf7e5-1695-4d45-844b-6a493cb2c30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07644944192844ad9a6df8005457cb7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:24:41Z,use_quota=True,user_id='67f44409bd904ae0b84ffc300df63c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Creating volume 49baf7e5-1695-4d45-844b-6a493cb2c30d {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:24:41 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:41 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d 1073741824 Sep 23 00:24:41 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d005c1f8-6d41-4c02-b411-13bf20ad27b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e30a54-f39f-4153-a3d1-1bfc788f6c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Volume volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 (ced1dddf-9e67-4d76-9365-3b258ad7fa55): created successfully Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e30a54-f39f-4153-a3d1-1bfc788f6c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Flow 'volume_create_manager' (ebf15401-057f-4f01-bd36-defb08ac21aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:41 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d342042c-5d4b-4dc2-90a9-08ec13995f3c tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Created volume successfully. Sep 23 00:24:42 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d 1073741824" returned: 0 in 0.791s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:42 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d Sep 23 00:24:42 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:43 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d" returned: 0 in 0.546s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fa55be-a915-48a7-b26c-413796b16caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49baf7e5-1695-4d45-844b-6a493cb2c30d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd6b2b4-adab-4afe-82d1-fdbe14cc0d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:24:43 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Volume volume-49baf7e5-1695-4d45-844b-6a493cb2c30d (49baf7e5-1695-4d45-844b-6a493cb2c30d): created successfully Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd6b2b4-adab-4afe-82d1-fdbe14cc0d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Flow 'volume_create_manager' (0a7b098b-a66c-4b2e-a654-ebd4ccbda9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:24:43 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-7ea88b1c-6023-4360-9909-9974144a5830 tempest-VolumesNegativeTest-1358535900 None] Created volume successfully. Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-029fcf24-06fb-44f7-a23b-3a10e21a291c req-86578c7f-e3d5-42f0-9dd4-300c4d1c9865 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-029fcf24-06fb-44f7-a23b-3a10e21a291c req-86578c7f-e3d5-42f0-9dd4-300c4d1c9865 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-029fcf24-06fb-44f7-a23b-3a10e21a291c req-86578c7f-e3d5-42f0-9dd4-300c4d1c9865 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-029fcf24-06fb-44f7-a23b-3a10e21a291c req-86578c7f-e3d5-42f0-9dd4-300c4d1c9865 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed057067-7ae8-4d86-a31b-265f8adac272', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:24:43 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-029fcf24-06fb-44f7-a23b-3a10e21a291c req-86578c7f-e3d5-42f0-9dd4-300c4d1c9865 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] attachment_update completed successfully. Sep 23 00:24:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-2b1f48ab-7bd6-41e4-9a4e-d636e456f2a0 req-b0d9e4a9-9c4e-4690-a253-cf2e74e20156 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Terminate volume connection completed successfully. Sep 23 00:24:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-2b1f48ab-7bd6-41e4-9a4e-d636e456f2a0 req-b0d9e4a9-9c4e-4690-a253-cf2e74e20156 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Deleting attachment ed057067-7ae8-4d86-a31b-265f8adac272. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:24:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Acquiring lock "cinder-ced1dddf-9e67-4d76-9365-3b258ad7fa55-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "cinder-ced1dddf-9e67-4d76-9365-3b258ad7fa55-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Acquiring lock "cinder-quobyte-ced1dddf-9e67-4d76-9365-3b258ad7fa55" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:24:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "cinder-quobyte-ced1dddf-9e67-4d76-9365-3b258ad7fa55" acquired by "delete_volume" :: waited 0.075s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:24:51 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceec75a-ef38-4721-9434-da6cf1159f25]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:24:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:52 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 Sep 23 00:24:52 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:52 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55" returned: 0 in 0.797s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:52 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55 Sep 23 00:24:52 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:53 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ced1dddf-9e67-4d76-9365-3b258ad7fa55" returned: 0 in 0.449s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "cinder-quobyte-ced1dddf-9e67-4d76-9365-3b258ad7fa55" released by "delete_volume" :: held 1.404s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:24:53 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Created reservations ['f667a2ce-54fb-4a54-ac5c-a8820d95fd1f', 'f23d8f73-1f1c-4f9b-bf40-1a467d0a1bfe', 'e855d6aa-3229-48c5-a539-ebe771cbfb6d', 'b499bfe1-dd71-431d-af21-c9374c21d721', 'b9f493f4-4088-4309-93d1-346ed719fe60'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:24:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:24:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:24:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:24:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:24:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:24:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:24:53 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:24:53 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:24:54 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Sep 23 00:24:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.716s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:24:54 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:24:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Deleted volume successfully. Sep 23 00:24:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-447959d1-1bea-4844-ac14-e83a271485f2 tempest-TestServerVolumeAttachScenarioOldVersion-994376211 None] Lock "cinder-ced1dddf-9e67-4d76-9365-3b258ad7fa55-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:03 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:25:03 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:03 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=20,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:03 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.991s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:25:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:25:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:25:04 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=17,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Flow 'volume_create_manager' (11ad773f-0eda-427d-a84f-30851729e22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688feb9f-a948-4321-b4aa-6248b3b14670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688feb9f-a948-4321-b4aa-6248b3b14670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2119735955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db99965b-0b5e-4263-a662-e03637a5b7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4986fa3c49644e1fae2c47db73637a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:27Z,use_quota=True,user_id='ba011b685de3499b860dac842edb4c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fa8946-debb-4054-9c90-5539fadb40b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fa8946-debb-4054-9c90-5539fadb40b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a512f0f-38e1-4440-b3db-33bb993f2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a512f0f-38e1-4440-b3db-33bb993f2896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db99965b-0b5e-4263-a662-e03637a5b7cb', 'volume_name': 'volume-db99965b-0b5e-4263-a662-e03637a5b7cb', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769cd248-8575-4f97-bda8-daaae519e405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (769cd248-8575-4f97-bda8-daaae519e405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68eefb20-18d9-4db7-90f5-507d3dfda46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:27 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Volume db99965b-0b5e-4263-a662-e03637a5b7cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db99965b-0b5e-4263-a662-e03637a5b7cb', 'volume_size': 1} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2119735955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db99965b-0b5e-4263-a662-e03637a5b7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4986fa3c49644e1fae2c47db73637a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:25:27Z,use_quota=True,user_id='ba011b685de3499b860dac842edb4c74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Creating volume db99965b-0b5e-4263-a662-e03637a5b7cb {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:25:27 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:27 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb 1073741824 Sep 23 00:25:27 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:27 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb 1073741824" returned: 0 in 0.874s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:28 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb Sep 23 00:25:28 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:28 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-dce46168-a052-47ea-9f9d-fd4feb32a247 req-6dcea9f9-6acc-4a42-bb96-2c15b11beb51 tempest-AttachVolumeNegativeTest-2043665308 None] Terminate volume connection completed successfully. Sep 23 00:25:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-dce46168-a052-47ea-9f9d-fd4feb32a247 req-6dcea9f9-6acc-4a42-bb96-2c15b11beb51 tempest-AttachVolumeNegativeTest-2043665308 None] Deleting attachment 060aa7da-a8b6-46b3-a816-187efbf97880. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:25:28 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb" returned: 0 in 0.565s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:25:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68eefb20-18d9-4db7-90f5-507d3dfda46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db99965b-0b5e-4263-a662-e03637a5b7cb', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4094a296-af95-452a-85e7-ff906341a831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:25:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Volume volume-db99965b-0b5e-4263-a662-e03637a5b7cb (db99965b-0b5e-4263-a662-e03637a5b7cb): created successfully Sep 23 00:25:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4094a296-af95-452a-85e7-ff906341a831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:25:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Flow 'volume_create_manager' (11ad773f-0eda-427d-a84f-30851729e22f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:25:28 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a4dc1698-ee92-4816-a412-3b4aa1204fe7 tempest-TestMinimumBasicScenario-1277629293 None] Created volume successfully. Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Acquiring lock "cinder-49baf7e5-1695-4d45-844b-6a493cb2c30d-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Lock "cinder-49baf7e5-1695-4d45-844b-6a493cb2c30d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Acquiring lock "cinder-quobyte-49baf7e5-1695-4d45-844b-6a493cb2c30d" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Lock "cinder-quobyte-49baf7e5-1695-4d45-844b-6a493cb2c30d" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1507034-3174-42f2-a20d-c45cbf274145]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-0008fedc-4ef7-4cee-b9b9-a110656cbe0d req-069392bb-9d76-4681-8028-18f7d6ec59ca tempest-TestMinimumBasicScenario-1277629293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-0008fedc-4ef7-4cee-b9b9-a110656cbe0d req-069392bb-9d76-4681-8028-18f7d6ec59ca tempest-TestMinimumBasicScenario-1277629293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-0008fedc-4ef7-4cee-b9b9-a110656cbe0d req-069392bb-9d76-4681-8028-18f7d6ec59ca tempest-TestMinimumBasicScenario-1277629293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-0008fedc-4ef7-4cee-b9b9-a110656cbe0d req-069392bb-9d76-4681-8028-18f7d6ec59ca tempest-TestMinimumBasicScenario-1277629293 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-db99965b-0b5e-4263-a662-e03637a5b7cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e16f75c-d571-425e-a6f1-0bc86a3309d3', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:25:32 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d Sep 23 00:25:32 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-0008fedc-4ef7-4cee-b9b9-a110656cbe0d req-069392bb-9d76-4681-8028-18f7d6ec59ca tempest-TestMinimumBasicScenario-1277629293 None] attachment_update completed successfully. Sep 23 00:25:33 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d" returned: 0 in 0.923s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:33 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d Sep 23 00:25:33 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:33 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-49baf7e5-1695-4d45-844b-6a493cb2c30d" returned: 0 in 0.578s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Lock "cinder-quobyte-49baf7e5-1695-4d45-844b-6a493cb2c30d" released by "delete_volume" :: held 1.628s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Created reservations ['9969bf58-f45b-4a38-a994-fd220e7f2554', '893c7943-a910-4041-a007-e0e2f13db0d6', 'c7fedabf-b142-485e-a72c-6bff43d67cf6', 'e7b61465-6ce2-49c9-ab6f-10947dd4d207', 'ae7da838-05e2-49c4-88a2-7a75cdfe08bd'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:25:34 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:25:34 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:25:34 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.400s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:25:34 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Deleted volume successfully. Sep 23 00:25:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d232872a-22e1-498b-802f-036c45f0b618 tempest-VolumesNegativeTest-1358535900 None] Lock "cinder-49baf7e5-1695-4d45-844b-6a493cb2c30d-delete_volume" released by "delete_volume" :: held 2.548s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:25:44 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:25:44 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=17,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:26:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:02 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:26:02 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:03 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.491s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:26:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:26:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:26:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:26:37 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Flow 'volume_create_manager' (8240364c-5620-40d9-9ce0-97cd147e9917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1571d69d-37aa-4c2d-b00a-252a2188f3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1571d69d-37aa-4c2d-b00a-252a2188f3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1168377583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ea4d57-8875-4f62-83bf-ad89dcb6b642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff8e3c9460948d78ecd96cee8a7ef16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:37Z,use_quota=True,user_id='732c2877181641bb84ad953a604d8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769e784d-52c9-4634-871a-213e0c7fb70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769e784d-52c9-4634-871a-213e0c7fb70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da7d987-6e03-41d0-954b-cd9649498d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:37 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:26:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da7d987-6e03-41d0-954b-cd9649498d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1ea4d57-8875-4f62-83bf-ad89dcb6b642', 'volume_name': 'volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23d6c01-6900-4ff5-bd80-223fd8b8ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23d6c01-6900-4ff5-bd80-223fd8b8ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737f76c1-717e-458a-a5ce-5383e6e555f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:38 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Volume e1ea4d57-8875-4f62-83bf-ad89dcb6b642: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:26:38 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Trying to clone e1ea4d57-8875-4f62-83bf-ad89dcb6b642 from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:26:38 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:26:38 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:26:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82e808f-e3f8-434f-86b9-e4d02e6e16d2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:39 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD Sep 23 00:26:39 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:39 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD" returned: 0 in 0.575s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:39 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb is fetched for user 732c2877181641bb84ad953a604d8fb4. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:26:39 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[53435384-7fea-43eb-9f72-f7284937c37b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:39 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD Sep 23 00:26:39 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:40 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1168377583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ea4d57-8875-4f62-83bf-ad89dcb6b642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff8e3c9460948d78ecd96cee8a7ef16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:37Z,use_quota=True,user_id='732c2877181641bb84ad953a604d8fb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Creating volume e1ea4d57-8875-4f62-83bf-ad89dcb6b642 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:40 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:40 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 1073741824 Sep 23 00:26:40 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Flow 'volume_create_manager' (7c8d6fdc-359b-49bf-89ae-4f071f630b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84b017b-5e36-4df8-bd30-31e06b1cb893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84b017b-5e36-4df8-bd30-31e06b1cb893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-531529355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd96b69a-7dc1-47f3-af73-9391b840abe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6307b679dfc4f3786656cbc520dd8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:40Z,use_quota=True,user_id='5b020b1399394dce8e567fcc6b82d6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383d4968-d257-4028-a373-8cebc0afb07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (383d4968-d257-4028-a373-8cebc0afb07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49d884d-e20f-431b-9113-f0ebe2eefe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c49d884d-e20f-431b-9113-f0ebe2eefe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd96b69a-7dc1-47f3-af73-9391b840abe2', 'volume_name': 'volume-bd96b69a-7dc1-47f3-af73-9391b840abe2', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef86119-9a43-4646-a448-afa387c3fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef86119-9a43-4646-a448-afa387c3fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff1f733-bee0-4cc4-8567-b2f799230797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:40 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Volume bd96b69a-7dc1-47f3-af73-9391b840abe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd96b69a-7dc1-47f3-af73-9391b840abe2', 'volume_size': 1} Sep 23 00:26:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:41 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 1073741824" returned: 0 in 0.838s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:41 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 Sep 23 00:26:41 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:41 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642" returned: 0 in 0.438s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.939s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-531529355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd96b69a-7dc1-47f3-af73-9391b840abe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6307b679dfc4f3786656cbc520dd8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:40Z,use_quota=True,user_id='5b020b1399394dce8e567fcc6b82d6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Creating volume bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:41 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:41 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 1073741824 Sep 23 00:26:41 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Attempting download of 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume e1ea4d57-8875-4f62-83bf-ad89dcb6b642. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6033b6-644d-4851-91f6-405bea39b0f3]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_8g4j9hj7 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:42 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_8g4j9hj7 Sep 23 00:26:42 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:42 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 1073741824" returned: 0 in 0.897s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:42 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_8g4j9hj7" returned: 0 in 0.770s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_8g4j9hj7 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:42 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 Sep 23 00:26:42 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:42 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2" returned: 0 in 0.393s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff1f733-bee0-4cc4-8567-b2f799230797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd96b69a-7dc1-47f3-af73-9391b840abe2', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:42 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_8g4j9hj7 Sep 23 00:26:42 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12629528-d745-4df6-89f1-dc74fdef2d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:43 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Volume volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 (bd96b69a-7dc1-47f3-af73-9391b840abe2): created successfully Sep 23 00:26:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12629528-d745-4df6-89f1-dc74fdef2d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Flow 'volume_create_manager' (7c8d6fdc-359b-49bf-89ae-4f071f630b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:43 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-be59aea5-2d2c-498e-8167-c44feed7b203 tempest-TestStampPattern-878754428 None] Created volume successfully. Sep 23 00:26:43 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_8g4j9hj7" returned: 1 in 0.788s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_8g4j9hj7' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:26:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf207a0-bbda-4399-a8e2-e076d9262b1a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:26:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:43 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD Sep 23 00:26:43 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:43 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:43 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb was qcow2, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:26:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:43 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 Sep 23 00:26:43 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:46 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642" returned: 0 in 3.017s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:46 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_ncp5xnbidevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:26:46 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Converted 112.00 MB image at 37.09 MB/s Sep 23 00:26:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:46 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 1G Sep 23 00:26:46 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:47 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 1G" returned: 0 in 0.537s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Downloaded image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume e1ea4d57-8875-4f62-83bf-ad89dcb6b642 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb for user 732c2877181641bb84ad953a604d8fb4 is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Marking volume e1ea4d57-8875-4f62-83bf-ad89dcb6b642 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Copying metadata from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb to e1ea4d57-8875-4f62-83bf-ad89dcb6b642. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Creating volume glance metadata for volume e1ea4d57-8875-4f62-83bf-ad89dcb6b642 backed by image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737f76c1-717e-458a-a5ce-5383e6e555f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded4b574-6494-4972-92de-91641ee81926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:47 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Volume volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 (e1ea4d57-8875-4f62-83bf-ad89dcb6b642): created successfully Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded4b574-6494-4972-92de-91641ee81926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Flow 'volume_create_manager' (8240364c-5620-40d9-9ce0-97cd147e9917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-89c15763-b320-47cd-a74c-18c5fe45560b tempest-TestShelveInstance-1030830725 None] Created volume successfully. Sep 23 00:26:52 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:26:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Flow 'volume_create_manager' (823f868e-a1db-4732-900c-1a6c485e9c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5b04a6-94ce-40e1-abfc-a0ddf4c9665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5b04a6-94ce-40e1-abfc-a0ddf4c9665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-710190097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5f67ea-aba5-43b6-a669-9f92d395adf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85125ba936bd4d00b9f81dd35bdd9913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:53Z,use_quota=True,user_id='f780627221c24f87af0af056a14baeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c4aa50-742c-4750-9678-ebdc9f2f876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c4aa50-742c-4750-9678-ebdc9f2f876e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780b922f-97dc-48bd-9a9b-2edc3f6f1d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780b922f-97dc-48bd-9a9b-2edc3f6f1d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b5f67ea-aba5-43b6-a669-9f92d395adf1', 'volume_name': 'volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b1fcdf-c85a-457a-a1c7-d0ec21697459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b1fcdf-c85a-457a-a1c7-d0ec21697459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b72636d-31c5-44d4-b5aa-1e20bea70b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:53 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Volume 7b5f67ea-aba5-43b6-a669-9f92d395adf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1', 'volume_size': 1} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-710190097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b5f67ea-aba5-43b6-a669-9f92d395adf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85125ba936bd4d00b9f81dd35bdd9913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:26:53Z,use_quota=True,user_id='f780627221c24f87af0af056a14baeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Creating volume 7b5f67ea-aba5-43b6-a669-9f92d395adf1 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:26:53 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:26:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:53 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 1073741824 Sep 23 00:26:53 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:54 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 1073741824" returned: 0 in 1.236s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:26:54 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 Sep 23 00:26:54 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:26:55 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 23 00:26:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1" returned: 0 in 0.721s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:26:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:26:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b72636d-31c5-44d4-b5aa-1e20bea70b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cab67cc-e35f-4a97-bbd2-67900428a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:26:55 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Volume volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 (7b5f67ea-aba5-43b6-a669-9f92d395adf1): created successfully Sep 23 00:26:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cab67cc-e35f-4a97-bbd2-67900428a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:26:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Flow 'volume_create_manager' (823f868e-a1db-4732-900c-1a6c485e9c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:26:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-aaa99772-841b-48f0-899b-2fcb794d693b tempest-AttachVolumeNegativeTest-2043665308 None] Created volume successfully. Sep 23 00:26:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-95188340-cdd3-41ca-8f46-f70681a721b2 req-436c51c4-a7d7-45ff-ae28-84b0bb648881 tempest-TestShelveInstance-1030830725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-95188340-cdd3-41ca-8f46-f70681a721b2 req-436c51c4-a7d7-45ff-ae28-84b0bb648881 tempest-TestShelveInstance-1030830725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-95188340-cdd3-41ca-8f46-f70681a721b2 req-436c51c4-a7d7-45ff-ae28-84b0bb648881 tempest-TestShelveInstance-1030830725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-95188340-cdd3-41ca-8f46-f70681a721b2 req-436c51c4-a7d7-45ff-ae28-84b0bb648881 tempest-TestShelveInstance-1030830725 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daa7abdb-e27f-4e2a-a008-17ec1a8c168e', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:26:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-95188340-cdd3-41ca-8f46-f70681a721b2 req-436c51c4-a7d7-45ff-ae28-84b0bb648881 tempest-TestShelveInstance-1030830725 None] attachment_update completed successfully. Sep 23 00:26:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-1dfa5e03-f06c-446e-89c0-780deb945ef7 req-e90cfb40-8353-417a-b5d8-5ef2eefdeb1c tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:26:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-1dfa5e03-f06c-446e-89c0-780deb945ef7 req-e90cfb40-8353-417a-b5d8-5ef2eefdeb1c tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:26:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-1dfa5e03-f06c-446e-89c0-780deb945ef7 req-e90cfb40-8353-417a-b5d8-5ef2eefdeb1c tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:26:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-1dfa5e03-f06c-446e-89c0-780deb945ef7 req-e90cfb40-8353-417a-b5d8-5ef2eefdeb1c tempest-AttachVolumeNegativeTest-2043665308 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43a5d7f7-acde-4392-9e58-53d72ad0d06b', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:26:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-1dfa5e03-f06c-446e-89c0-780deb945ef7 req-e90cfb40-8353-417a-b5d8-5ef2eefdeb1c tempest-AttachVolumeNegativeTest-2043665308 None] attachment_update completed successfully. Sep 23 00:27:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-c4862b52-340c-45e2-bc78-277b385ff11b req-fa7f718d-ec4c-421a-b330-f6cd7f6254aa tempest-AttachVolumeNegativeTest-2043665308 None] Terminate volume connection completed successfully. Sep 23 00:27:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-c4862b52-340c-45e2-bc78-277b385ff11b req-fa7f718d-ec4c-421a-b330-f6cd7f6254aa tempest-AttachVolumeNegativeTest-2043665308 None] Deleting attachment 43a5d7f7-acde-4392-9e58-53d72ad0d06b. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:27:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:02 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:27:02 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:03 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.864s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:27:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:27:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:27:05 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-ff513fbe-e3f5-4900-998b-d261bb53d430 req-dfd62500-56c6-4568-af94-f541141e9e84 tempest-TestMinimumBasicScenario-1277629293 None] Terminate volume connection completed successfully. Sep 23 00:27:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-ff513fbe-e3f5-4900-998b-d261bb53d430 req-dfd62500-56c6-4568-af94-f541141e9e84 tempest-TestMinimumBasicScenario-1277629293 None] Deleting attachment 8e16f75c-d571-425e-a6f1-0bc86a3309d3. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:27:07 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-95188340-cdd3-41ca-8f46-f70681a721b2 req-b7534fe1-4b4d-491b-b77d-d3e60a123fc8 tempest-TestShelveInstance-1030830725 None] Terminate volume connection completed successfully. Sep 23 00:27:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-95188340-cdd3-41ca-8f46-f70681a721b2 req-b7534fe1-4b4d-491b-b77d-d3e60a123fc8 tempest-TestShelveInstance-1030830725 None] Deleting attachment daa7abdb-e27f-4e2a-a008-17ec1a8c168e. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:27:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Acquiring lock "cinder-db99965b-0b5e-4263-a662-e03637a5b7cb-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Lock "cinder-db99965b-0b5e-4263-a662-e03637a5b7cb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Acquiring lock "cinder-quobyte-db99965b-0b5e-4263-a662-e03637a5b7cb" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Lock "cinder-quobyte-db99965b-0b5e-4263-a662-e03637a5b7cb" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c2dd89-0525-4bdf-9436-23d7fe427873]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:08 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb Sep 23 00:27:08 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb" returned: 0 in 0.698s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:09 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb Sep 23 00:27:09 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:09 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-db99965b-0b5e-4263-a662-e03637a5b7cb" returned: 0 in 0.407s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Lock "cinder-quobyte-db99965b-0b5e-4263-a662-e03637a5b7cb" released by "delete_volume" :: held 1.221s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Created reservations ['a9672253-8fd9-40f4-80e5-0013c8c6a86b', '99cfc545-cd7a-4211-bef9-9a0dddadea5c', 'e5738b51-4c29-4deb-9759-13f7cd80ab7b', '46caa888-a36c-45b2-97cb-1a3d8f485252', '92917f24-ff1e-4619-85fc-fec3cf6015f6'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:10 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:27:10 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:10 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.512s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:10 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Deleted volume successfully. Sep 23 00:27:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f24c65ef-74e2-4dab-b1bc-3223dfa7b94b tempest-TestMinimumBasicScenario-1277629293 None] Lock "cinder-db99965b-0b5e-4263-a662-e03637a5b7cb-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Acquiring lock "cinder-e1ea4d57-8875-4f62-83bf-ad89dcb6b642-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Lock "cinder-e1ea4d57-8875-4f62-83bf-ad89dcb6b642-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Acquiring lock "cinder-quobyte-e1ea4d57-8875-4f62-83bf-ad89dcb6b642" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Lock "cinder-quobyte-e1ea4d57-8875-4f62-83bf-ad89dcb6b642" acquired by "delete_volume" :: waited 0.039s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:14 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74997c3-ea50-4028-a6be-966973bf8f99]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:14 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 Sep 23 00:27:14 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:14 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642" returned: 0 in 0.600s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:14 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642 Sep 23 00:27:14 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:15 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e1ea4d57-8875-4f62-83bf-ad89dcb6b642" returned: 0 in 0.672s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Lock "cinder-quobyte-e1ea4d57-8875-4f62-83bf-ad89dcb6b642" released by "delete_volume" :: held 1.381s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:15 devstack cinder-volume[87138]: DEBUG cinder.quota [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Created reservations ['dea00ad7-bcd6-4f27-ba6c-bee608b159ea', '5d296a9c-6a7d-4845-bd08-ebcb86492e6f', '8a2d9b82-ca7f-48e1-84c0-1d1bd3111ecb', '1c20241b-ee70-4388-937a-a9e104150e2c', 'b223d1f4-2478-484c-9dd3-d6a864eaf947'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:27:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:15 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:27:15 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:16 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.636s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:16 devstack cinder-volume[87138]: DEBUG cinder.manager [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:27:16 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Deleted volume successfully. Sep 23 00:27:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-1b3cc1aa-d54c-49a8-b385-615a51469733 req-8bfa153e-ed86-40b7-aed5-859a2cac434a tempest-TestShelveInstance-1030830725 None] Lock "cinder-e1ea4d57-8875-4f62-83bf-ad89dcb6b642-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:27:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-460a2b80-1bc4-4952-92e0-c65c2a6e8e40 req-be0e5c8a-f4d9-4ad5-93a9-820a7a38fb6d tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-460a2b80-1bc4-4952-92e0-c65c2a6e8e40 req-be0e5c8a-f4d9-4ad5-93a9-820a7a38fb6d tempest-TestStampPattern-878754428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-460a2b80-1bc4-4952-92e0-c65c2a6e8e40 req-be0e5c8a-f4d9-4ad5-93a9-820a7a38fb6d tempest-TestStampPattern-878754428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-460a2b80-1bc4-4952-92e0-c65c2a6e8e40 req-be0e5c8a-f4d9-4ad5-93a9-820a7a38fb6d tempest-TestStampPattern-878754428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-bd96b69a-7dc1-47f3-af73-9391b840abe2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '587234b7-aa2b-4f40-a6fa-cd0a73278b20', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:27:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-460a2b80-1bc4-4952-92e0-c65c2a6e8e40 req-be0e5c8a-f4d9-4ad5-93a9-820a7a38fb6d tempest-TestStampPattern-878754428 None] attachment_update completed successfully. Sep 23 00:27:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-e6b0603c-0b36-40ff-9ed1-96ada07ef7b1 req-3a612af5-f5a7-4d06-a4dc-7564faeff42b tempest-TestStampPattern-878754428 None] Terminate volume connection completed successfully. Sep 23 00:27:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-e6b0603c-0b36-40ff-9ed1-96ada07ef7b1 req-3a612af5-f5a7-4d06-a4dc-7564faeff42b tempest-TestStampPattern-878754428 None] Deleting attachment 587234b7-aa2b-4f40-a6fa-cd0a73278b20. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:27:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Creating offline snapshot ccd56095-b71d-4d71-9771-be78732c1828 of volume bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:27:30 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8218ef-8b6f-491d-af5f-dd0cd2687015]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:30 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 Sep 23 00:27:30 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:30 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2" returned: 0 in 0.553s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:30 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 1G Sep 23 00:27:30 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:31 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 1G" returned: 0 in 0.724s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:31 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 Sep 23 00:27:31 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:31 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828" returned: 0 in 0.421s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:31 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 is being set with open permissions: ugo+rw Sep 23 00:27:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 Sep 23 00:27:32 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828" returned: 0 in 0.412s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.info Sep 23 00:27:32 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:32 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.info" returned: 0 in 0.355s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:32 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.info is being set with open permissions: ugo+rw Sep 23 00:27:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:32 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.info Sep 23 00:27:32 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:33 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.info" returned: 0 in 0.391s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-328f68ba-cbc7-4812-9cbc-665c4ca14738 tempest-TestStampPattern-878754428 None] Create snapshot completed successfully Sep 23 00:27:43 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=56,cinder:UPDATE=33,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:43 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=37,cinder:SELECT=50,cinder:INSERT=16,cinder:DELETE=2 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Flow 'volume_create_manager' (2d1863ac-66fd-4774-91ec-db4ee12b5b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1af9b8-d9c3-4b58-9497-3959e4f99eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1af9b8-d9c3-4b58-9497-3959e4f99eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2130558104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3912a4e-0be4-472a-afc3-8bc8bd3c6a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6307b679dfc4f3786656cbc520dd8d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ccd56095-b71d-4d71-9771-be78732c1828,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:27:49Z,use_quota=True,user_id='5b020b1399394dce8e567fcc6b82d6c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07b653f-bc62-4b56-930d-33ac1b49ef5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07b653f-bc62-4b56-930d-33ac1b49ef5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31900621-a069-4d8a-a036-bb4be1951533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31900621-a069-4d8a-a036-bb4be1951533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e3912a4e-0be4-472a-afc3-8bc8bd3c6a39', 'volume_name': 'volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39', 'volume_size': 1, 'snapshot_id': 'ccd56095-b71d-4d71-9771-be78732c1828'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c78f16-d3aa-459c-ae46-b50881612073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c78f16-d3aa-459c-ae46-b50881612073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baceeaf7-a6d0-4125-9044-259117d370b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:27:48 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Volume e3912a4e-0be4-472a-afc3-8bc8bd3c6a39: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39', 'volume_size': 1, 'snapshot_id': 'ccd56095-b71d-4d71-9771-be78732c1828'} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Acquiring lock "cinder-quobyte-ccd56095-b71d-4d71-9771-be78732c1828-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" by "_create_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-ccd56095-b71d-4d71-9771-be78732c1828-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Creating volume e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 from snapshot ccd56095-b71d-4d71-9771-be78732c1828 {{(pid=87138) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Acquiring lock "cinder-quobyte-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] snapshot: ccd56095-b71d-4d71-9771-be78732c1828, volume: e3912a4e-0be4-472a-afc3-8bc8bd3c6a39, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b7c5f4-d5f3-4c8b-829c-d29b2a6bcaf8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:49 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 Sep 23 00:27:49 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:49 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828" returned: 0 in 0.732s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd96b69a-7dc1-47f3-af73-9391b840abe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbed119-9bf7-48f1-96c0-e605a0676492]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:27:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:50 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 Sep 23 00:27:50 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:50 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 23 00:27:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2" returned: 0 in 0.724s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:27:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:27:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:27:50 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:27:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:27:50 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 Sep 23 00:27:50 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:27:58 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:27:59 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:01 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" returned: 0 in 10.702s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2, size 1024.00 MB, duration 10.70 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:28:01 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Converted 1024.00 MB image at 95.67 MB/s Sep 23 00:28:01 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 is being set with open permissions: ugo+rw Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:01 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 Sep 23 00:28:01 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:01 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" returned: 0 in 0.376s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" released by "_copy_volume_from_snapshot" :: held 12.721s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-ccd56095-b71d-4d71-9771-be78732c1828-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" released by "_create_volume_from_snapshot" :: held 12.834s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.857s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baceeaf7-a6d0-4125-9044-259117d370b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39', 'volume_size': 1, 'snapshot_id': 'ccd56095-b71d-4d71-9771-be78732c1828'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b7f06b-c0e2-4fc0-b57b-ae081b06d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:01 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Volume volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 (e3912a4e-0be4-472a-afc3-8bc8bd3c6a39): created successfully Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b7f06b-c0e2-4fc0-b57b-ae081b06d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Flow 'volume_create_manager' (2d1863ac-66fd-4774-91ec-db4ee12b5b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:02 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f53f14b0-0c4d-419e-a75b-f01e9f4293a8 tempest-TestStampPattern-878754428 None] Created volume successfully. Sep 23 00:28:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:02 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:28:02 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:03 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.506s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:28:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:28:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Flow 'volume_create_manager' (ae33eb8b-ff9d-49e3-b3ff-fd7c1fb0ca31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b384729a-4a04-46cc-9986-0b08c7add4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b384729a-4a04-46cc-9986-0b08c7add4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-726453109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2b0972-0a54-4f3a-b49c-e0afcd629362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85125ba936bd4d00b9f81dd35bdd9913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:07Z,use_quota=True,user_id='f780627221c24f87af0af056a14baeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e525658-6260-4097-a271-12fd5d319965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e525658-6260-4097-a271-12fd5d319965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2203c9c9-7193-480c-9151-6d4f1ddadd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2203c9c9-7193-480c-9151-6d4f1ddadd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f2b0972-0a54-4f3a-b49c-e0afcd629362', 'volume_name': 'volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8efc66-7862-4911-908b-a73ecf65f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c8efc66-7862-4911-908b-a73ecf65f0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a138a5-3cf1-4eb5-9d74-69c9ca53dd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:07 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Volume 5f2b0972-0a54-4f3a-b49c-e0afcd629362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362', 'volume_size': 1} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-726453109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2b0972-0a54-4f3a-b49c-e0afcd629362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85125ba936bd4d00b9f81dd35bdd9913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:07Z,use_quota=True,user_id='f780627221c24f87af0af056a14baeca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Creating volume 5f2b0972-0a54-4f3a-b49c-e0afcd629362 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:07 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:28:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:07 devstack sudo[101322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 1073741824 Sep 23 00:28:07 devstack sudo[101322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:08 devstack sudo[101322]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 1073741824" returned: 0 in 1.143s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:08 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 Sep 23 00:28:08 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:09 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362" returned: 0 in 0.645s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a138a5-3cf1-4eb5-9d74-69c9ca53dd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd63067d-a325-4449-988d-8125830da508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:09 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Volume volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 (5f2b0972-0a54-4f3a-b49c-e0afcd629362): created successfully Sep 23 00:28:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd63067d-a325-4449-988d-8125830da508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Flow 'volume_create_manager' (ae33eb8b-ff9d-49e3-b3ff-fd7c1fb0ca31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-db33d133-f193-4372-a153-10d05527d612 tempest-AttachVolumeNegativeTest-2043665308 None] Created volume successfully. Sep 23 00:28:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-fdacd495-99c4-40f3-9d44-137955141b07 req-ecb4667c-648b-4afc-b4b9-6566a9649c6f tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-fdacd495-99c4-40f3-9d44-137955141b07 req-ecb4667c-648b-4afc-b4b9-6566a9649c6f tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-fdacd495-99c4-40f3-9d44-137955141b07 req-ecb4667c-648b-4afc-b4b9-6566a9649c6f tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-fdacd495-99c4-40f3-9d44-137955141b07 req-ecb4667c-648b-4afc-b4b9-6566a9649c6f tempest-AttachVolumeNegativeTest-2043665308 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43532b03-be57-4499-9b7d-52ecebb170ea', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:28:12 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-fdacd495-99c4-40f3-9d44-137955141b07 req-ecb4667c-648b-4afc-b4b9-6566a9649c6f tempest-AttachVolumeNegativeTest-2043665308 None] attachment_update completed successfully. Sep 23 00:28:15 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-a94b5038-33e8-46b3-8424-f84aaea8ed22 req-db6dda62-c720-4549-b67b-36a2f3ab7f61 tempest-AttachVolumeNegativeTest-2043665308 None] Terminate volume connection completed successfully. Sep 23 00:28:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-a94b5038-33e8-46b3-8424-f84aaea8ed22 req-db6dda62-c720-4549-b67b-36a2f3ab7f61 tempest-AttachVolumeNegativeTest-2043665308 None] Deleting attachment 43532b03-be57-4499-9b7d-52ecebb170ea. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:28:22 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:25 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=7,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Flow 'volume_create_manager' (b1952795-266a-4dd8-a1ea-c0415dcdef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d6132d-327a-40a4-8288-f2bd83e845e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d6132d-327a-40a4-8288-f2bd83e845e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1586715559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e34118-dbfe-4da0-9a91-bcff79a45900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7af3d0c42794d3eab98c1de7f3de5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:27Z,use_quota=True,user_id='eba92b3ea709405fb27b1e99b8cc76ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a08548-a261-4b7c-9aca-da9a02aa92cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a08548-a261-4b7c-9aca-da9a02aa92cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65107804-1047-4cbb-af24-be8c673a49b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65107804-1047-4cbb-af24-be8c673a49b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e34118-dbfe-4da0-9a91-bcff79a45900', 'volume_name': 'volume-b7e34118-dbfe-4da0-9a91-bcff79a45900', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef545ef-8285-4f29-82a3-3127a7f3fd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef545ef-8285-4f29-82a3-3127a7f3fd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31f9b54-d35e-43ba-9bc6-8425c1819920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:27 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Volume b7e34118-dbfe-4da0-9a91-bcff79a45900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e34118-dbfe-4da0-9a91-bcff79a45900', 'volume_size': 1} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1586715559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e34118-dbfe-4da0-9a91-bcff79a45900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7af3d0c42794d3eab98c1de7f3de5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:27Z,use_quota=True,user_id='eba92b3ea709405fb27b1e99b8cc76ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Creating volume b7e34118-dbfe-4da0-9a91-bcff79a45900 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:28:27 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:28:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:27 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 1073741824 Sep 23 00:28:27 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:28 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 1073741824" returned: 0 in 1.141s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:29 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 Sep 23 00:28:29 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:29 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900" returned: 0 in 0.473s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:28:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31f9b54-d35e-43ba-9bc6-8425c1819920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e34118-dbfe-4da0-9a91-bcff79a45900', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af54f8d-436f-4586-8e03-3eca731628f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:29 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Volume volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 (b7e34118-dbfe-4da0-9a91-bcff79a45900): created successfully Sep 23 00:28:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af54f8d-436f-4586-8e03-3eca731628f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Flow 'volume_create_manager' (b1952795-266a-4dd8-a1ea-c0415dcdef4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-18c2d00e-1511-4453-bd64-51f7f043ee9e tempest-TestImageHashVerification-1894545930 None] Created volume successfully. Sep 23 00:28:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "cinder-5f2b0972-0a54-4f3a-b49c-e0afcd629362-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-5f2b0972-0a54-4f3a-b49c-e0afcd629362-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "cinder-quobyte-5f2b0972-0a54-4f3a-b49c-e0afcd629362" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-quobyte-5f2b0972-0a54-4f3a-b49c-e0afcd629362" acquired by "delete_volume" :: waited 0.051s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:31 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e92ef6f-3f30-4d68-aa7a-420dbe4abdf3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:31 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 Sep 23 00:28:31 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:32 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362" returned: 0 in 1.239s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:32 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362 Sep 23 00:28:32 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8423d8d-3308-4f41-91c5-eb9550e799de]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:33 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f2b0972-0a54-4f3a-b49c-e0afcd629362" returned: 0 in 0.825s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-quobyte-5f2b0972-0a54-4f3a-b49c-e0afcd629362" released by "delete_volume" :: held 2.201s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:33 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 Sep 23 00:28:33 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Created reservations ['14d773ef-f6b1-4f79-a093-c4e11620459d', 'de5c46be-7545-4f60-9a8f-7fb1b26a19fe', '01cd667d-6802-4265-ae90-63b5ecbb059f', '4c219bdd-43ab-43ef-ae6f-1e0e243b425b', '64e77df0-c2b0-4b1c-a4f5-8248169ec98f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:33 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:28:33 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:34 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900" returned: 0 in 0.844s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:34 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8ef899-bde0-4e29-8c9b-fe86468848a0]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:34 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.582s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:34 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:34 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 Sep 23 00:28:34 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:34 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Deleted volume successfully. Sep 23 00:28:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-470c62ba-2c26-4065-ad57-49d44c369b95 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-5f2b0972-0a54-4f3a-b49c-e0afcd629362-delete_volume" released by "delete_volume" :: held 3.395s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "cinder-7b5f67ea-aba5-43b6-a669-9f92d395adf1-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-7b5f67ea-aba5-43b6-a669-9f92d395adf1-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:35 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900" returned: 0 in 1.114s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 /opt/stack/data/cinder/conversion/b7e34118-dbfe-4da0-9a91-bcff79a45900.temp_image.eed8d90e-f920-4b89-bb1e-5a6755ab330an7sce9_e.img {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "cinder-quobyte-7b5f67ea-aba5-43b6-a669-9f92d395adf1" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-quobyte-7b5f67ea-aba5-43b6-a669-9f92d395adf1" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:35 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 /opt/stack/data/cinder/conversion/b7e34118-dbfe-4da0-9a91-bcff79a45900.temp_image.eed8d90e-f920-4b89-bb1e-5a6755ab330an7sce9_e.img Sep 23 00:28:35 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:35 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5dd5a0-8629-4343-bc6f-676c8459c9b5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:35 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 Sep 23 00:28:35 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:36 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1" returned: 0 in 1.121s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:36 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1 Sep 23 00:28:36 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:37 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7b5f67ea-aba5-43b6-a669-9f92d395adf1" returned: 0 in 1.306s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-quobyte-7b5f67ea-aba5-43b6-a669-9f92d395adf1" released by "delete_volume" :: held 2.569s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:38 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Created reservations ['9aa20f63-cfa8-4950-b199-64c73b986769', '39cc8143-5334-4ccc-a6ab-ae52f2a22dc1', '040dc862-38b8-4af5-a2ac-b9f5ecd51262', 'dac6ce3f-9d73-4722-9065-a555a8beb52c', 'c5219c0a-3e14-4336-af78-09d3d5d1c314'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:38 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:28:38 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:39 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 1.172s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:39 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:39 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Deleted volume successfully. Sep 23 00:28:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ed0fcef4-dfc5-46dd-9692-c80db3466434 tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-7b5f67ea-aba5-43b6-a669-9f92d395adf1-delete_volume" released by "delete_volume" :: held 4.745s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "cinder-734d51da-edf5-485a-8c77-154759b2bd55-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-734d51da-edf5-485a-8c77-154759b2bd55-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "cinder-quobyte-734d51da-edf5-485a-8c77-154759b2bd55" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:28:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-quobyte-734d51da-edf5-485a-8c77-154759b2bd55" acquired by "delete_volume" :: waited 0.088s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:28:40 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef911df8-1f71-4a34-b00c-f55cd6649fcb]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:41 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55 Sep 23 00:28:41 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:42 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55" returned: 0 in 1.262s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:42 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55 Sep 23 00:28:42 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:42 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-734d51da-edf5-485a-8c77-154759b2bd55" returned: 0 in 0.820s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-quobyte-734d51da-edf5-485a-8c77-154759b2bd55" released by "delete_volume" :: held 2.261s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:43 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Created reservations ['32282c9e-54fb-48a5-bd1b-1dd423e5be1b', '0b3e72f4-3517-4bc7-9c2b-1098405c5d18', '1716b1fb-ae70-4863-b2b5-3382eedb4601', '92ef84c1-7f70-4df2-ab59-26d80605b7c5', 'faf77bb1-4e77-4102-8913-c247e4bd8b5d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:28:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:28:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:28:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:28:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:28:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:43 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:28:43 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:44 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.935s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:44 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:28:44 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Deleted volume successfully. Sep 23 00:28:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3e9ad847-cc10-42d0-8671-b6fdd6be02ca tempest-AttachVolumeNegativeTest-2043665308 None] Lock "cinder-734d51da-edf5-485a-8c77-154759b2bd55-delete_volume" released by "delete_volume" :: held 4.181s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:28:47 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 /opt/stack/data/cinder/conversion/b7e34118-dbfe-4da0-9a91-bcff79a45900.temp_image.eed8d90e-f920-4b89-bb1e-5a6755ab330an7sce9_e.img" returned: 0 in 12.444s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc70929-2e6c-473a-af27-bcb0bae56363]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:28:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:28:47 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 Sep 23 00:28:47 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:28:48 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Sep 23 00:28:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900" returned: 0 in 0.807s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:28:48 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900, size 1024.00 MB, duration 12.44 sec, destination /opt/stack/data/cinder/conversion/b7e34118-dbfe-4da0-9a91-bcff79a45900.temp_image.eed8d90e-f920-4b89-bb1e-5a6755ab330an7sce9_e.img {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:28:48 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Converted 1024.00 MB image at 82.28 MB/s Sep 23 00:28:48 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] eed8d90e-f920-4b89-bb1e-5a6755ab330a was raw, no need to convert to raw {{(pid=87138) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Flow 'volume_create_manager' (21ae9d32-807a-46ad-a914-777a076d82f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2d3ead-e316-4303-9eaf-d68f0fd73053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a2d3ead-e316-4303-9eaf-d68f0fd73053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1864550939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1992310f-e862-4a54-8fae-8ed33337b071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a5ab0394254e71931779b80b38efc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:49Z,use_quota=True,user_id='360dd8034d014ca88d3535cca4cae112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d3f152-af78-45d1-908e-54040a9801c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d3f152-af78-45d1-908e-54040a9801c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632a065e-2159-4166-9a67-6ebf4ce3441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632a065e-2159-4166-9a67-6ebf4ce3441d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1992310f-e862-4a54-8fae-8ed33337b071', 'volume_name': 'volume-1992310f-e862-4a54-8fae-8ed33337b071', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248f9fb0-c02d-42e2-baad-2a3558697415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248f9fb0-c02d-42e2-baad-2a3558697415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9806f81-9118-436d-b17e-5eaf8a2876bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:49 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Volume 1992310f-e862-4a54-8fae-8ed33337b071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1992310f-e862-4a54-8fae-8ed33337b071', 'volume_size': 1} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:49 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Flow 'volume_create_manager' (562f1f34-ef88-44e5-b88b-a658a44f86d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a8ceeb-2f81-48d8-bc90-fc568c843dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a8ceeb-2f81-48d8-bc90-fc568c843dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-807087396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3eb3e8b-e357-4a80-af52-16f1a2891b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a5ab0394254e71931779b80b38efc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:50Z,use_quota=True,user_id='360dd8034d014ca88d3535cca4cae112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1ecefd-c290-47a0-b787-1c051ebc2204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1ecefd-c290-47a0-b787-1c051ebc2204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239beff8-ac16-4265-bc3d-d6a0cb0ec023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (239beff8-ac16-4265-bc3d-d6a0cb0ec023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3eb3e8b-e357-4a80-af52-16f1a2891b2b', 'volume_name': 'volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9a894d-116e-48db-bf4c-c1b3d21588fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9a894d-116e-48db-bf4c-c1b3d21588fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03b01b8-95f6-4493-bf82-253e5d1beafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:28:50 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Volume c3eb3e8b-e357-4a80-af52-16f1a2891b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b', 'volume_size': 1} Sep 23 00:28:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:28:59 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=24,cinder:INSERT=11,cinder:UPDATE=28,cinder:DELETE=4 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:00 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=34,cinder:SELECT=23,cinder:INSERT=5 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-cfb9357b-6ca8-48fc-831e-e7d978271990 req-e9465404-a858-4bfb-a402-eaa594b425e1 tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:02 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:29:02 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:03 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.690s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 28 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Flow 'volume_create_manager' (f1c42105-77f3-4830-b824-937f42b31f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd46a938-3757-4bb0-9ac7-6dcb777cdc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd46a938-3757-4bb0-9ac7-6dcb777cdc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1351842497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295fb7d7-95f5-44c1-9e9f-15b6dafadcc8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bc61ec55f764fa4902ddfea7b4d9a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:04Z,use_quota=True,user_id='5f4ef4b127244d9480b8619015f5e429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df251679-f1d2-4e0f-b8c5-71d8071d7dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df251679-f1d2-4e0f-b8c5-71d8071d7dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d733996d-9ed0-4c49-80e0-23934c0dd247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d733996d-9ed0-4c49-80e0-23934c0dd247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295fb7d7-95f5-44c1-9e9f-15b6dafadcc8', 'volume_name': 'volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038a9a0f-a26f-4dce-8faf-90a0b88a3714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038a9a0f-a26f-4dce-8faf-90a0b88a3714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8397ad90-b1ec-45de-857a-81c00b858255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:03 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Volume 295fb7d7-95f5-44c1-9e9f-15b6dafadcc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8', 'volume_size': 1} Sep 23 00:29:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 48.163s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Uploaded volume to glance image-id: eed8d90e-f920-4b89-bb1e-5a6755ab330a. {{(pid=87138) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.879s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1864550939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1992310f-e862-4a54-8fae-8ed33337b071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a5ab0394254e71931779b80b38efc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:49Z,use_quota=True,user_id='360dd8034d014ca88d3535cca4cae112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Creating volume 1992310f-e862-4a54-8fae-8ed33337b071 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:21 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:29:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:21 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-dd09f6c5-525a-4877-bfeb-a2b1c59d89a7 tempest-TestImageHashVerification-1894545930 None] Copy volume to image completed successfully. Sep 23 00:29:21 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071 1073741824 Sep 23 00:29:21 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:22 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071 1073741824" returned: 0 in 0.714s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:22 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071 Sep 23 00:29:22 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:22 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071" returned: 0 in 0.316s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 32.320s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-807087396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3eb3e8b-e357-4a80-af52-16f1a2891b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a5ab0394254e71931779b80b38efc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:28:50Z,use_quota=True,user_id='360dd8034d014ca88d3535cca4cae112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Creating volume c3eb3e8b-e357-4a80-af52-16f1a2891b2b {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:22 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9806f81-9118-436d-b17e-5eaf8a2876bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1992310f-e862-4a54-8fae-8ed33337b071', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:22 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b 1073741824 Sep 23 00:29:22 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a7551d-e52d-49af-8b54-07a8c8481931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:22 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Volume volume-1992310f-e862-4a54-8fae-8ed33337b071 (1992310f-e862-4a54-8fae-8ed33337b071): created successfully Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a7551d-e52d-49af-8b54-07a8c8481931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Flow 'volume_create_manager' (21ae9d32-807a-46ad-a914-777a076d82f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8c262086-e224-4fe8-9f20-31560b635d49 tempest-TestServerVolumeAttachmentScenario-884075658 None] Created volume successfully. Sep 23 00:29:23 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b 1073741824" returned: 0 in 0.657s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Acquiring lock "cinder-b7e34118-dbfe-4da0-9a91-bcff79a45900-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:23 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b Sep 23 00:29:23 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Lock "cinder-b7e34118-dbfe-4da0-9a91-bcff79a45900-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Acquiring lock "cinder-quobyte-b7e34118-dbfe-4da0-9a91-bcff79a45900" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Lock "cinder-quobyte-b7e34118-dbfe-4da0-9a91-bcff79a45900" acquired by "delete_volume" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb97017-f965-478f-9f94-4daf372dc995]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 Sep 23 00:29:23 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:23 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b" returned: 0 in 0.357s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-cfb9357b-6ca8-48fc-831e-e7d978271990 req-e9465404-a858-4bfb-a402-eaa594b425e1 tempest-TestStampPattern-878754428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.555s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-cfb9357b-6ca8-48fc-831e-e7d978271990 req-e9465404-a858-4bfb-a402-eaa594b425e1 tempest-TestStampPattern-878754428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.759s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1351842497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295fb7d7-95f5-44c1-9e9f-15b6dafadcc8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4bc61ec55f764fa4902ddfea7b4d9a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:04Z,use_quota=True,user_id='5f4ef4b127244d9480b8619015f5e429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Creating volume 295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:23 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c03b01b8-95f6-4493-bf82-253e5d1beafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:23 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 1073741824 Sep 23 00:29:23 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e630587-9097-4e48-90c2-0acd9faf5646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Volume volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b (c3eb3e8b-e357-4a80-af52-16f1a2891b2b): created successfully Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e630587-9097-4e48-90c2-0acd9faf5646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Flow 'volume_create_manager' (562f1f34-ef88-44e5-b88b-a658a44f86d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cfb9357b-6ca8-48fc-831e-e7d978271990 req-e9465404-a858-4bfb-a402-eaa594b425e1 tempest-TestStampPattern-878754428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '251688ac-dc80-42fb-a8c5-f151b8d5dd4f', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:29:23 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9e28ac39-838b-4bbb-a6b6-fe99368ad44a tempest-TestServerVolumeAttachmentScenario-884075658 None] Created volume successfully. Sep 23 00:29:23 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-cfb9357b-6ca8-48fc-831e-e7d978271990 req-e9465404-a858-4bfb-a402-eaa594b425e1 tempest-TestStampPattern-878754428 None] attachment_update completed successfully. Sep 23 00:29:23 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900" returned: 0 in 0.575s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:23 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900 Sep 23 00:29:23 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b7e34118-dbfe-4da0-9a91-bcff79a45900" returned: 0 in 0.459s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Lock "cinder-quobyte-b7e34118-dbfe-4da0-9a91-bcff79a45900" released by "delete_volume" :: held 1.119s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:24 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 1073741824" returned: 0 in 0.872s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Created reservations ['77e44170-b887-4214-809a-d84992e61864', 'e44935e5-24b2-4e97-a181-6ec14c152440', 'd4d5d8f9-d4b8-4d59-b662-9e3f6ea99405', '92a6a402-ebf8-44ab-9cc8-98b5c4f06fdb', '7832a4d6-6a7c-477e-b1af-6bf945b60c53'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:24 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 Sep 23 00:29:24 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:24 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:29:24 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:25 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8" returned: 0 in 0.561s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8397ad90-b1ec-45de-857a-81c00b858255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dceac5c-1f89-4f4c-8264-ca54322f21f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Volume volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 (295fb7d7-95f5-44c1-9e9f-15b6dafadcc8): created successfully Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dceac5c-1f89-4f4c-8264-ca54322f21f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Flow 'volume_create_manager' (f1c42105-77f3-4830-b824-937f42b31f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-cb43585c-5038-4f0c-a783-cf7b88ad6e45 req-294b9fc1-b8eb-495d-84b5-7dc8339d5e5c tempest-VolumesGetTestJSON-796034254 None] Created volume successfully. Sep 23 00:29:25 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.544s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Deleted volume successfully. Sep 23 00:29:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fb5b79d3-73ac-4fbc-bf4a-9183489bd642 tempest-TestImageHashVerification-1894545930 None] Lock "cinder-b7e34118-dbfe-4da0-9a91-bcff79a45900-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Acquiring lock "cinder-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Lock "cinder-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Acquiring lock "cinder-quobyte-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Lock "cinder-quobyte-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8" acquired by "delete_volume" :: waited 0.048s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:26 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2cfdef-20ad-4c10-b08f-e35fb9cd2ffa]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:26 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 Sep 23 00:29:26 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:27 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8" returned: 0 in 0.529s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:27 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8 Sep 23 00:29:27 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:27 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-f9d70469-4426-47a8-ab0f-a0a6a65b629a req-1319998f-a89d-44a0-a73a-1341adac1bed tempest-TestStampPattern-878754428 None] Terminate volume connection completed successfully. Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-f9d70469-4426-47a8-ab0f-a0a6a65b629a req-1319998f-a89d-44a0-a73a-1341adac1bed tempest-TestStampPattern-878754428 None] Deleting attachment 251688ac-dc80-42fb-a8c5-f151b8d5dd4f. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:29:27 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8" returned: 0 in 0.316s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Lock "cinder-quobyte-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8" released by "delete_volume" :: held 0.932s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG cinder.quota [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Created reservations ['a20f1ed8-7a42-49c5-84d9-6f3ac76b4486', '1afaec18-3746-4400-a0c3-99c1241e9d2a', '11809797-2ce2-4c8d-a8e6-75ad6f1a40cc', 'a0fd6e56-e45c-4995-b7bf-d1db1aa2b1fa', '685a2638-e476-46a2-b144-1b3e41c6d8b0'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:27 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:29:27 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:28 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.392s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:28 devstack cinder-volume[87138]: DEBUG cinder.manager [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:28 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Deleted volume successfully. Sep 23 00:29:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [req-fc286582-8d15-4a8a-b309-581fde3d2386 req-34fd2343-1738-4b33-b2e1-ce0e0fe76f7d tempest-VolumesGetTestJSON-796034254 None] Lock "cinder-295fb7d7-95f5-44c1-9e9f-15b6dafadcc8-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Acquiring lock "cinder-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Lock "cinder-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Acquiring lock "cinder-quobyte-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:34 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adbaf71-bbeb-467e-a2e9-1c85a1cb1f90]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:34 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 Sep 23 00:29:34 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:34 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" returned: 0 in 0.628s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:34 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39 Sep 23 00:29:34 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" returned: 0 in 0.513s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39" released by "delete_volume" :: held 1.250s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Created reservations ['fddd6980-7389-41bb-b705-b4a4d27f15c7', '9e3deccf-deda-47f1-b435-f2c0deb20898', '8e63d7b3-da6b-4dcd-8a84-4743c22dc418', 'e117552c-7654-4dd3-84b0-9a7ba6dd2270', '452169a1-ddc9-4ef5-94b3-919e7f53bc9f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:35 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:29:35 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-baca9f54-0bc4-4f1b-a489-ffd11add6e6e req-c525b218-bdc9-428d-8f6f-b998532fe7f7 tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-baca9f54-0bc4-4f1b-a489-ffd11add6e6e req-c525b218-bdc9-428d-8f6f-b998532fe7f7 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-baca9f54-0bc4-4f1b-a489-ffd11add6e6e req-c525b218-bdc9-428d-8f6f-b998532fe7f7 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-baca9f54-0bc4-4f1b-a489-ffd11add6e6e req-c525b218-bdc9-428d-8f6f-b998532fe7f7 tempest-TestServerVolumeAttachmentScenario-884075658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-1992310f-e862-4a54-8fae-8ed33337b071', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '218627d7-cbac-4b8a-984f-b3208a9e8b87', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:29:36 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.416s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:36 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-baca9f54-0bc4-4f1b-a489-ffd11add6e6e req-c525b218-bdc9-428d-8f6f-b998532fe7f7 tempest-TestServerVolumeAttachmentScenario-884075658 None] attachment_update completed successfully. Sep 23 00:29:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Deleted volume successfully. Sep 23 00:29:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-71feee5a-4a9e-48ae-8cea-25100e91de61 tempest-TestStampPattern-878754428 None] Lock "cinder-e3912a4e-0be4-472a-afc3-8bc8bd3c6a39-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Acquiring lock "cinder-ccd56095-b71d-4d71-9771-be78732c1828-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Lock "cinder-ccd56095-b71d-4d71-9771-be78732c1828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Acquiring lock "cinder-quobyte-bd96b69a-7dc1-47f3-af73-9391b840abe2" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-bd96b69a-7dc1-47f3-af73-9391b840abe2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Acquiring lock "cinder-quobyte-ccd56095-b71d-4d71-9771-be78732c1828" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-ccd56095-b71d-4d71-9771-be78732c1828" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Deleting offline snapshot ccd56095-b71d-4d71-9771-be78732c1828 of volume bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] snapshot_file for this snap is: volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c3c8d4-e879-46b2-8442-2b33f44f8c40]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:37 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 Sep 23 00:29:37 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:38 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828" returned: 0 in 0.764s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd96b69a-7dc1-47f3-af73-9391b840abe2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f339f6-9602-410d-b850-5e0a7509faab]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:38 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 Sep 23 00:29:38 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:39 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2" returned: 0 in 0.874s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:39 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 Sep 23 00:29:39 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:39 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828" returned: 0 in 0.727s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:39 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828 Sep 23 00:29:39 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:40 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2.ccd56095-b71d-4d71-9771-be78732c1828" returned: 0 in 0.493s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-ccd56095-b71d-4d71-9771-be78732c1828" released by "_delete_snapshot" :: held 3.144s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-bd96b69a-7dc1-47f3-af73-9391b840abe2" released by "delete_snapshot" :: held 3.219s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:40 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Created reservations ['f668db9f-9da5-41de-8c00-48c1a886b880', '4d2d408e-82c8-479d-8d57-6c0d9c20c759', '459e9655-c59f-4c9d-8c2d-00f3c610fb3c', '91d98ee0-329a-402f-b79e-02fdd98e4d4a', '7b759290-d2f4-49fd-8834-53ced930eeee'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Delete snapshot completed successfully. Sep 23 00:29:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1f2386d8-6f0b-4ccc-80a9-e2a1a73adb91 tempest-TestStampPattern-878754428 None] Lock "cinder-ccd56095-b71d-4d71-9771-be78732c1828-delete_snapshot" released by "delete_snapshot" :: held 3.512s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-7d6c08b0-fa6c-4dba-bf84-410216cc3624 req-cd7f083c-4c0d-49f8-aad6-5d538c4066f3 tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-7d6c08b0-fa6c-4dba-bf84-410216cc3624 req-cd7f083c-4c0d-49f8-aad6-5d538c4066f3 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [req-7d6c08b0-fa6c-4dba-bf84-410216cc3624 req-cd7f083c-4c0d-49f8-aad6-5d538c4066f3 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-7d6c08b0-fa6c-4dba-bf84-410216cc3624 req-cd7f083c-4c0d-49f8-aad6-5d538c4066f3 tempest-TestServerVolumeAttachmentScenario-884075658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140', 'name': 'volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c85e3b9-d991-43a4-ad7f-b7f5ebff669e', 'enforce_multipath': True} {{(pid=87138) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 23 00:29:45 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-7d6c08b0-fa6c-4dba-bf84-410216cc3624 req-cd7f083c-4c0d-49f8-aad6-5d538c4066f3 tempest-TestServerVolumeAttachmentScenario-884075658 None] attachment_update completed successfully. Sep 23 00:29:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Acquiring lock "cinder-bd96b69a-7dc1-47f3-af73-9391b840abe2-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Lock "cinder-bd96b69a-7dc1-47f3-af73-9391b840abe2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Acquiring lock "cinder-quobyte-bd96b69a-7dc1-47f3-af73-9391b840abe2" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-bd96b69a-7dc1-47f3-af73-9391b840abe2" acquired by "delete_volume" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aee77d-1a4a-40fb-ae59-0f34119c436a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0e51c121-d0aa-4537-b59b-6dcd8e2b3da7 tempest-GroupSnapshotsTest-2125997571 None] Group tempest-GroupSnapshotsTest-Group-876073036: creating Sep 23 00:29:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0e51c121-d0aa-4537-b59b-6dcd8e2b3da7 tempest-GroupSnapshotsTest-2125997571 None] Group tempest-GroupSnapshotsTest-Group-876073036: created successfully Sep 23 00:29:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0e51c121-d0aa-4537-b59b-6dcd8e2b3da7 tempest-GroupSnapshotsTest-2125997571 None] Create group completed successfully. Sep 23 00:29:47 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 Sep 23 00:29:47 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:48 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-d148e4b1-cb4a-444d-aa1d-4b49e1f437d1 req-af96bdd6-eac0-45a8-b576-aa1f0ce9690f tempest-TestServerVolumeAttachmentScenario-884075658 None] Terminate volume connection completed successfully. Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-d148e4b1-cb4a-444d-aa1d-4b49e1f437d1 req-af96bdd6-eac0-45a8-b576-aa1f0ce9690f tempest-TestServerVolumeAttachmentScenario-884075658 None] Deleting attachment 8c85e3b9-d991-43a4-ad7f-b7f5ebff669e. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:29:48 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2" returned: 0 in 0.501s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:48 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2 Sep 23 00:29:48 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:48 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bd96b69a-7dc1-47f3-af73-9391b840abe2" returned: 0 in 0.382s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Lock "cinder-quobyte-bd96b69a-7dc1-47f3-af73-9391b840abe2" released by "delete_volume" :: held 1.034s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Created reservations ['ab549a90-36db-432f-8654-e3e9e4bb51f1', '6ba83040-4478-4cea-af6e-383ffdfa12b2', 'beb6e2ae-f8df-497f-a95e-c769c5d0ef79', 'f5b73491-403d-44b6-b62f-4856a09cd03e', '1e115892-7486-41c1-a361-2650210c59f5'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:49 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:29:49 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:49 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.484s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:49 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:29:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Deleted volume successfully. Sep 23 00:29:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9b7cb66c-c17a-4ab7-a9a8-e522330f7180 tempest-TestStampPattern-878754428 None] Lock "cinder-bd96b69a-7dc1-47f3-af73-9391b840abe2-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:29:49 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Flow 'volume_create_manager' (18ebbd28-54e1-4613-8c16-875ff4dc403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4b8d22-64e3-4813-92bf-8a5f31275130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a4b8d22-64e3-4813-92bf-8a5f31275130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-657872548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f4d0122-2d19-49ba-a95b-9e64ab45dd61,host='devstack@QuobyteHD#QuobyteHD',id=ab307b13-8171-4280-97dc-1effe3dcd2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf2cd49a3d45329dfea301153fcb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:50Z,use_quota=True,user_id='80fd2c4adef042ee887da95bed991608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc518cb5-75e2-46f9-96c1-3ae0d9dd40ff),volume_type_id=fc518cb5-75e2-46f9-96c1-3ae0d9dd40ff)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e522580-ad9a-4447-afb5-c15567937c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e522580-ad9a-4447-afb5-c15567937c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57070408-c908-4c85-b938-4c0210f88317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57070408-c908-4c85-b938-4c0210f88317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab307b13-8171-4280-97dc-1effe3dcd2fe', 'volume_name': 'volume-ab307b13-8171-4280-97dc-1effe3dcd2fe', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efee84d3-1947-4118-ab45-6f69c4e560b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efee84d3-1947-4118-ab45-6f69c4e560b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe937773-fe77-46bc-998a-21ddbc46e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:50 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Volume ab307b13-8171-4280-97dc-1effe3dcd2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab307b13-8171-4280-97dc-1effe3dcd2fe', 'volume_size': 1} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f4d0122-2d19-49ba-a95b-9e64ab45dd61,created_at=2026-09-22T22:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-657872548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f4d0122-2d19-49ba-a95b-9e64ab45dd61,host='devstack@QuobyteHD#QuobyteHD',id=ab307b13-8171-4280-97dc-1effe3dcd2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf2cd49a3d45329dfea301153fcb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:50Z,use_quota=True,user_id='80fd2c4adef042ee887da95bed991608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc518cb5-75e2-46f9-96c1-3ae0d9dd40ff),volume_type_id=fc518cb5-75e2-46f9-96c1-3ae0d9dd40ff)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Creating volume ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:50 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:50 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe 1073741824 Sep 23 00:29:50 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:50 devstack cinder-volume[87138]: INFO cinder.volume.manager [req-d77db177-dd52-4baa-ad6c-3d577d7a989b req-ff4afd32-aa60-49e7-899e-05b240be4c08 tempest-TestServerVolumeAttachmentScenario-884075658 None] Terminate volume connection completed successfully. Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [req-d77db177-dd52-4baa-ad6c-3d577d7a989b req-ff4afd32-aa60-49e7-899e-05b240be4c08 tempest-TestServerVolumeAttachmentScenario-884075658 None] Deleting attachment 218627d7-cbac-4b8a-984f-b3208a9e8b87. {{(pid=87138) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Flow 'volume_create_manager' (239dccb1-1702-473d-ba39-aece583ddfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb5d48a-aff2-465e-9cee-68366f440ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb5d48a-aff2-465e-9cee-68366f440ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443a930d-cbbc-4c0a-8562-b79201a4eb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81faa902525c4cb0a438baf99e53f038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:51Z,use_quota=True,user_id='ebf26c18e3c64ec1b9fa2ff2f6701dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30911fd-7767-4293-9447-97f066dc1b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b30911fd-7767-4293-9447-97f066dc1b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe06111-c660-44f5-a7fe-7cbcc986052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe06111-c660-44f5-a7fe-7cbcc986052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443a930d-cbbc-4c0a-8562-b79201a4eb44', 'volume_name': 'volume-443a930d-cbbc-4c0a-8562-b79201a4eb44', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0de2e22-0b05-4e9b-8494-f9601081b2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0de2e22-0b05-4e9b-8494-f9601081b2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9085f5-08d7-4b7a-8d01-72d8c690e469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:50 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Volume 443a930d-cbbc-4c0a-8562-b79201a4eb44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443a930d-cbbc-4c0a-8562-b79201a4eb44', 'volume_size': 1} Sep 23 00:29:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:51 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe 1073741824" returned: 0 in 1.070s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:51 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe Sep 23 00:29:51 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:51 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe" returned: 0 in 0.292s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.726s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443a930d-cbbc-4c0a-8562-b79201a4eb44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81faa902525c4cb0a438baf99e53f038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:51Z,use_quota=True,user_id='ebf26c18e3c64ec1b9fa2ff2f6701dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Creating volume 443a930d-cbbc-4c0a-8562-b79201a4eb44 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:51 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe937773-fe77-46bc-998a-21ddbc46e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab307b13-8171-4280-97dc-1effe3dcd2fe', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:51 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 1073741824 Sep 23 00:29:51 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c45e263-a09c-4cb8-a4e0-b38b5cbf435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:51 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Volume volume-ab307b13-8171-4280-97dc-1effe3dcd2fe (ab307b13-8171-4280-97dc-1effe3dcd2fe): created successfully Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c45e263-a09c-4cb8-a4e0-b38b5cbf435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Flow 'volume_create_manager' (18ebbd28-54e1-4613-8c16-875ff4dc403b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-02451ada-0f7b-411b-90da-fa41dfc89a37 tempest-GroupSnapshotsTest-2125997571 None] Created volume successfully. Sep 23 00:29:52 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 1073741824" returned: 0 in 0.757s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:52 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 Sep 23 00:29:52 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:52 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44" returned: 0 in 0.587s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9085f5-08d7-4b7a-8d01-72d8c690e469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443a930d-cbbc-4c0a-8562-b79201a4eb44', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b5f664-7bb0-4b58-a7bd-a6a22104b395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:52 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Volume volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 (443a930d-cbbc-4c0a-8562-b79201a4eb44): created successfully Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b5f664-7bb0-4b58-a7bd-a6a22104b395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Flow 'volume_create_manager' (239dccb1-1702-473d-ba39-aece583ddfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6b8db0f2-2275-4986-9ee7-a729d67cb5ea tempest-CinderUnicodeTest-573867649 None] Created volume successfully. Sep 23 00:29:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] GroupSnapshot 478f0b69-2eba-4ce8-a8e8-2cf18fce90ed: creating. Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Group snapshot 478f0b69-2eba-4ce8-a8e8-2cf18fce90ed: creating. {{(pid=87138) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Creating offline snapshot 0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 of volume ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c873e0f7-4b23-4fa2-a185-42e529e31855]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe Sep 23 00:29:53 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:53 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe" returned: 0 in 0.540s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:53 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 1G Sep 23 00:29:53 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 1G" returned: 0 in 0.788s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab307b13-8171-4280-97dc-1effe3dcd2fe -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:54 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab307b13-8171-4280-97dc-1effe3dcd2fe -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 Sep 23 00:29:54 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:54 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:29:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Flow 'volume_create_manager' (1ada7654-2633-44a3-b90f-56e2721e1471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c197a90-3c62-4cd6-917a-034d78db83b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c197a90-3c62-4cd6-917a-034d78db83b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-375221184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81faa902525c4cb0a438baf99e53f038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:55Z,use_quota=True,user_id='ebf26c18e3c64ec1b9fa2ff2f6701dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1e1e6e-2095-4f41-a85f-2c4bb66dc976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1e1e6e-2095-4f41-a85f-2c4bb66dc976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e5c673-b760-42e1-859e-31c6eb2ff26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e5c673-b760-42e1-859e-31c6eb2ff26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd', 'volume_name': 'volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97782ae-82bb-46e9-8c08-3405d82b1b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97782ae-82bb-46e9-8c08-3405d82b1b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9a6c2a-a3d4-438e-b3da-8d7b04981119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:55 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Volume 3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd', 'volume_size': 1} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:55 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab307b13-8171-4280-97dc-1effe3dcd2fe -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6" returned: 0 in 0.548s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:55 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:55 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 Sep 23 00:29:55 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:55 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6" returned: 0 in 0.354s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:55 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.info Sep 23 00:29:55 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:55 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.info" returned: 0 in 0.444s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:55 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:29:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:55 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.info Sep 23 00:29:55 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:56 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.info" returned: 0 in 0.396s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.197s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.288s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:29:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-375221184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81faa902525c4cb0a438baf99e53f038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:29:55Z,use_quota=True,user_id='ebf26c18e3c64ec1b9fa2ff2f6701dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Creating volume 3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:56 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:56 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd 1073741824 Sep 23 00:29:56 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-76edf87b-d516-419e-a4f8-fce1926d18de tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 478f0b69-2eba-4ce8-a8e8-2cf18fce90ed: created successfully Sep 23 00:29:56 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd 1073741824" returned: 0 in 0.620s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:57 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd Sep 23 00:29:57 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:57 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" returned: 0 in 0.498s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:29:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed9a6c2a-a3d4-438e-b3da-8d7b04981119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e80afd-2b13-4a8d-b0c8-95427997bca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:29:57 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Volume volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd (3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd): created successfully Sep 23 00:29:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e80afd-2b13-4a8d-b0c8-95427997bca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:29:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Flow 'volume_create_manager' (1ada7654-2633-44a3-b90f-56e2721e1471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:29:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a07a9438-5e35-4c3c-92f9-ed7ea6132c22 tempest-CinderUnicodeTest-573867649 None] Created volume successfully. Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6-1680fef9-6492-4716-b49a-f102999c2ae6" by "_create_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6-1680fef9-6492-4716-b49a-f102999c2ae6" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Creating volume 1680fef9-6492-4716-b49a-f102999c2ae6 from snapshot 0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 {{(pid=87138) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-1680fef9-6492-4716-b49a-f102999c2ae6" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-1680fef9-6492-4716-b49a-f102999c2ae6" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] snapshot: 0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6, volume: 1680fef9-6492-4716-b49a-f102999c2ae6, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c159216-369c-4fd9-af9b-bfdd572d8cc2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "cinder-c3eb3e8b-e357-4a80-af52-16f1a2891b2b-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "cinder-c3eb3e8b-e357-4a80-af52-16f1a2891b2b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:59 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 Sep 23 00:29:59 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "cinder-quobyte-c3eb3e8b-e357-4a80-af52-16f1a2891b2b" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "cinder-quobyte-c3eb3e8b-e357-4a80-af52-16f1a2891b2b" acquired by "delete_volume" :: waited 0.042s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[2def6984-303b-491c-94a6-db14a34da785]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:59 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b Sep 23 00:29:59 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:59 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6" returned: 0 in 0.578s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab307b13-8171-4280-97dc-1effe3dcd2fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd382f89-e9a3-42ec-8846-054c252420da]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:59 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe Sep 23 00:29:59 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:29:59 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b" returned: 0 in 0.503s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:29:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:29:59 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b Sep 23 00:29:59 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:00 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe" returned: 0 in 0.502s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:00 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 Sep 23 00:30:00 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:00 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c3eb3e8b-e357-4a80-af52-16f1a2891b2b" returned: 0 in 0.413s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "cinder-quobyte-c3eb3e8b-e357-4a80-af52-16f1a2891b2b" released by "delete_volume" :: held 1.010s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Created reservations ['b8a3ca8e-3e1b-4919-bef6-2c328efad7aa', '834d3d8c-2c5b-45b7-b307-5c02f0dd3bd8', '7078ce25-ffe7-419e-a725-9e63b63c8220', 'da06ec7c-b146-407e-905e-f20eeae26903', '2be65b24-767b-4314-8c6d-d4eed34d9353'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:00 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:00 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:01 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.511s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:01 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Deleted volume successfully. Sep 23 00:30:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-33e73891-b30e-4697-9f13-a2734653b8cd tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "cinder-c3eb3e8b-e357-4a80-af52-16f1a2891b2b-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "cinder-1992310f-e862-4a54-8fae-8ed33337b071-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "cinder-1992310f-e862-4a54-8fae-8ed33337b071-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "cinder-quobyte-1992310f-e862-4a54-8fae-8ed33337b071" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "cinder-quobyte-1992310f-e862-4a54-8fae-8ed33337b071" acquired by "delete_volume" :: waited 0.048s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:01 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b899e745-cf03-4593-8ea7-72b7ee846fb6]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:02 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071 Sep 23 00:30:02 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:02 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071" returned: 0 in 0.868s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:02 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071 Sep 23 00:30:02 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:02 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:02 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:03 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.761s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:30:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:30:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:30:03 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1992310f-e862-4a54-8fae-8ed33337b071" returned: 0 in 0.880s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "cinder-quobyte-1992310f-e862-4a54-8fae-8ed33337b071" released by "delete_volume" :: held 1.883s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:03 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Created reservations ['f18c2fd5-8e1e-46f1-bf85-403a372e4b3f', '5e589d6b-13c2-4142-9522-13dd713d1446', 'f00e3678-2bb5-4f30-b881-3cd1923f7a69', '4895b55c-937d-4300-8be3-15154a095af1', 'ed8754c9-1897-406a-807b-3513035fd7df'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:04 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:04 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:04 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.524s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:04 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:04 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Deleted volume successfully. Sep 23 00:30:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-548cf292-37e0-4fe3-83ae-d29a0b668583 tempest-TestServerVolumeAttachmentScenario-884075658 None] Lock "cinder-1992310f-e862-4a54-8fae-8ed33337b071-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:09 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6" returned: 0 in 9.287s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe, size 1024.00 MB, duration 9.29 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:30:09 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Converted 1024.00 MB image at 110.25 MB/s Sep 23 00:30:09 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:09 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 Sep 23 00:30:09 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:09 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6" returned: 0 in 0.326s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-1680fef9-6492-4716-b49a-f102999c2ae6" released by "_copy_volume_from_snapshot" :: held 10.893s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6-1680fef9-6492-4716-b49a-f102999c2ae6" released by "_create_volume_from_snapshot" :: held 10.999s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.049s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.769s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Creating offline snapshot 5883782f-f22b-4089-83ad-1d09e6d92724 of volume 3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76c710-66d6-4679-bcea-75fc72415863]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-854a90fb-a7f0-4eaa-8315-06975cfd77b5 tempest-GroupSnapshotsTest-2125997571 None] Create group from source-snapshot-478f0b69-2eba-4ce8-a8e8-2cf18fce90ed completed successfully. Sep 23 00:30:10 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd Sep 23 00:30:10 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:10 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" returned: 0 in 0.597s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:10 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 1G Sep 23 00:30:10 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:11 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 1G" returned: 0 in 0.629s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:11 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 Sep 23 00:30:11 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:11 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-1680fef9-6492-4716-b49a-f102999c2ae6" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:11 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-1680fef9-6492-4716-b49a-f102999c2ae6" acquired by "delete_volume" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:11 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac734f5b-0b81-4751-907a-3c651efc6545]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:11 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724" returned: 0 in 0.624s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:11 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 is being set with open permissions: ugo+rw Sep 23 00:30:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:11 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 Sep 23 00:30:11 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:11 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 Sep 23 00:30:11 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:12 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724" returned: 0 in 0.426s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:12 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6" returned: 0 in 0.789s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:12 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.info Sep 23 00:30:12 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:12 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6 Sep 23 00:30:12 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:12 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1680fef9-6492-4716-b49a-f102999c2ae6" returned: 0 in 0.338s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-1680fef9-6492-4716-b49a-f102999c2ae6" released by "delete_volume" :: held 1.207s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:12 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.info" returned: 0 in 0.444s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:12 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.info is being set with open permissions: ugo+rw Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:12 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.info Sep 23 00:30:12 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['7c4a48cc-4b75-4eea-b098-b8bc7b49ca22'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:12 devstack cinder-volume[87138]: WARNING cinder.quota [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-268458916 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-268458916, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:12 devstack cinder-volume[87138]: WARNING cinder.quota [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-268458916 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-268458916, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:12 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['734f47a7-2bea-452e-82d1-4919e3dd1923', '6e959db3-f857-4ec5-b919-8754f073da1f', '48067172-5d3a-4aad-91a7-cdf4af285595', '869a9fcf-b9de-4046-a7a1-6d19ca9f148d', '7ab6e213-e0a3-4ab8-931e-d729f97d102c'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:13 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.info" returned: 0 in 0.465s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.362s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:13 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3c84e89f-3eb3-4268-84cd-5ee4406000e2 tempest-CinderUnicodeTest-573867649 None] Create snapshot completed successfully Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:13 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:13 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:13 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 478f0b69-2eba-4ce8-a8e8-2cf18fce90ed: deleting Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 478f0b69-2eba-4ce8-a8e8-2cf18fce90ed: deleting {{(pid=87138) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-ab307b13-8171-4280-97dc-1effe3dcd2fe" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-ab307b13-8171-4280-97dc-1effe3dcd2fe" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Deleting offline snapshot 0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 of volume ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] snapshot_file for this snap is: volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c87d51-d308-45f9-bfa9-ffefb27f61a6]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:13 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.483s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:13 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:13 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3b27b504-c17e-4eeb-adc1-971d0dcbc8b4 tempest-GroupSnapshotsTest-2125997571 None] Delete group completed successfully. Sep 23 00:30:13 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 Sep 23 00:30:13 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Acquiring lock "cinder-5883782f-f22b-4089-83ad-1d09e6d92724-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-5883782f-f22b-4089-83ad-1d09e6d92724-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Acquiring lock "cinder-quobyte-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-quobyte-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Acquiring lock "cinder-quobyte-5883782f-f22b-4089-83ad-1d09e6d92724" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-quobyte-5883782f-f22b-4089-83ad-1d09e6d92724" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Deleting offline snapshot 5883782f-f22b-4089-83ad-1d09e6d92724 of volume 3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] snapshot_file for this snap is: volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:30:14 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6" returned: 0 in 0.760s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab307b13-8171-4280-97dc-1effe3dcd2fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba75405f-eb2a-4cd0-b1cb-b49bf687b989]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed3a887-80d0-4aa5-9ce7-d091c4547ce3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:14 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 Sep 23 00:30:14 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:14 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe Sep 23 00:30:14 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:15 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724" returned: 0 in 0.829s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:15 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df076d4-58d3-4084-a74c-eba961f8d5aa]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:15 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe" returned: 0 in 1.020s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:15 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd Sep 23 00:30:15 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:15 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 Sep 23 00:30:15 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:16 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" returned: 0 in 0.615s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:16 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 Sep 23 00:30:16 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:16 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6" returned: 0 in 0.618s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:16 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6 Sep 23 00:30:16 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:16 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724" returned: 0 in 0.632s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:16 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe.0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6" returned: 0 in 0.498s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:16 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724 Sep 23 00:30:16 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-0e6864ce-4fe2-41a0-a3bd-8c7835cb46d6" released by "_delete_snapshot" :: held 3.070s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-ab307b13-8171-4280-97dc-1effe3dcd2fe" released by "delete_snapshot" :: held 3.118s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:16 devstack cinder-volume[87138]: WARNING cinder.quota [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-268458916 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-268458916, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:16 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['4b31b6de-5ba6-4af2-9e69-ff40282be080', '2cc69940-998b-40ff-a3fb-971296241621', '9c20b5a2-bf69-4ee9-9d83-36d7b0e6d199', '2e700824-6c37-431f-ba87-3ec44bffb500', '6b86f7b7-3749-47e9-86bd-bcfaa32ec9ba'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:17 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd.5883782f-f22b-4089-83ad-1d09e6d92724" returned: 0 in 0.462s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-quobyte-5883782f-f22b-4089-83ad-1d09e6d92724" released by "_delete_snapshot" :: held 2.797s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-quobyte-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" released by "delete_snapshot" :: held 2.859s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-87faec46-74a4-4095-b10d-fdf142731ea0 tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 478f0b69-2eba-4ce8-a8e8-2cf18fce90ed: deleted successfully Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Created reservations ['e1ce355e-c7f6-4749-a132-4e0bfe18e82c', 'bc691460-5465-4533-919c-dbf59249b511', 'b65165d3-be75-4edd-b553-509454decc7d', 'a7e155cc-09b6-49d7-a4ae-4ee618fdf46f', 'a52a2525-9319-4edf-a749-7e94a0fcef31'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Delete snapshot completed successfully. Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6f821f9-54fd-4159-8a56-ceda416584e0 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-5883782f-f22b-4089-83ad-1d09e6d92724-delete_snapshot" released by "delete_snapshot" :: held 3.123s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Acquiring lock "cinder-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Lock "cinder-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Acquiring lock "cinder-quobyte-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Lock "cinder-quobyte-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d44662-d97c-46d0-be7b-f26e12de7091]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:18 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd Sep 23 00:30:18 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:18 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" returned: 0 in 0.673s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-ab307b13-8171-4280-97dc-1effe3dcd2fe" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:18 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd Sep 23 00:30:18 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-ab307b13-8171-4280-97dc-1effe3dcd2fe" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:18 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dfbf4c-534e-4b94-bc3f-7dd1292fd069]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:18 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe Sep 23 00:30:18 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:19 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" returned: 0 in 0.467s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Lock "cinder-quobyte-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd" released by "delete_volume" :: held 1.254s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Created reservations ['059d9ec8-eefb-41cc-afa4-aa5cbf0f758a', 'c1b793f9-3faa-4bbb-8823-e68cc5f7f8ba', '95e66f56-9f8e-4eb2-9fcb-323ae85e9336', '46255466-7685-4103-abdf-a835788e9c2e', 'd2ec95b3-46a9-49e2-a37a-bbaee2ecf71a'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:19 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe" returned: 0 in 0.591s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:19 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:19 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:19 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe Sep 23 00:30:19 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:19 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.343s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:19 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Deleted volume successfully. Sep 23 00:30:19 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ab307b13-8171-4280-97dc-1effe3dcd2fe" returned: 0 in 0.362s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6af07d5-699a-4528-8d75-ce1e680e269a tempest-CinderUnicodeTest-573867649 None] Lock "cinder-3b3ba96f-85f3-4e6d-8fb3-b1ef0d6b00dd-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-ab307b13-8171-4280-97dc-1effe3dcd2fe" released by "delete_volume" :: held 1.061s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['57f4de47-c50f-4839-b29f-9fcb87c64571'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=130,cinder:SELECT=127,cinder:INSERT=29,cinder:DELETE=7 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=122,cinder:UPDATE=120,cinder:DELETE=7,cinder:INSERT=37 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:30:20 devstack cinder-volume[87138]: WARNING cinder.db.api [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-268458916'] Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['8b2a4202-c12b-4983-862c-eacd696fe8b3', '7819dea4-1098-4766-b663-1dce3d924753', '53726e9a-1f62-44b3-97f7-a4df6c2b1f3b', '9c2e458f-8e45-4cf4-bbc3-f8c8a67dc7ba', '9f7b2f57-0b8a-4bc8-87f8-9227de86d3c3'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Acquiring lock "cinder-443a930d-cbbc-4c0a-8562-b79201a4eb44-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-443a930d-cbbc-4c0a-8562-b79201a4eb44-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Acquiring lock "cinder-quobyte-443a930d-cbbc-4c0a-8562-b79201a4eb44" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:20 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-quobyte-443a930d-cbbc-4c0a-8562-b79201a4eb44" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:20 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8d54bb-03fc-46d0-8fef-afe086f73372]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:20 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 Sep 23 00:30:20 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:20 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.477s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:20 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-46408ec1-1dd7-4dcc-a4bd-564922becd15 tempest-GroupSnapshotsTest-2125997571 None] Delete group completed successfully. Sep 23 00:30:21 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44" returned: 0 in 0.632s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:21 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44 Sep 23 00:30:21 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:21 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-443a930d-cbbc-4c0a-8562-b79201a4eb44" returned: 0 in 0.415s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-quobyte-443a930d-cbbc-4c0a-8562-b79201a4eb44" released by "delete_volume" :: held 1.137s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Created reservations ['aed8ddee-8269-4d31-9114-78a3a239b008', '29741ebe-9547-4db3-b43b-a9bee13ea158', '37cf7276-089f-4148-982d-101a3ff19291', '3fa1ef90-1a5b-4a5a-8af4-f08fc659d49a', '241af03f-25cb-4494-9652-b46cf55ce150'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:21 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:21 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-60752e30-8a0b-4e93-bc8f-dc311ea7be4c tempest-GroupSnapshotsTest-2125997571 None] Group tempest-GroupSnapshotsTest-Group-1783053597: creating Sep 23 00:30:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-60752e30-8a0b-4e93-bc8f-dc311ea7be4c tempest-GroupSnapshotsTest-2125997571 None] Group tempest-GroupSnapshotsTest-Group-1783053597: created successfully Sep 23 00:30:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-60752e30-8a0b-4e93-bc8f-dc311ea7be4c tempest-GroupSnapshotsTest-2125997571 None] Create group completed successfully. Sep 23 00:30:22 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.509s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:22 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Deleted volume successfully. Sep 23 00:30:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb20d7fa-8427-436b-ba13-3e5ae0f116f7 tempest-CinderUnicodeTest-573867649 None] Lock "cinder-443a930d-cbbc-4c0a-8562-b79201a4eb44-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Flow 'volume_create_manager' (71bc3b22-fdcd-4d13-a05d-8885b352f6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c5c39c-c048-4191-8e8b-a617f27f4d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c5c39c-c048-4191-8e8b-a617f27f4d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1418598932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8126f7b3-f34f-42e7-a27b-f6e54d44d36d,host='devstack@QuobyteHD#QuobyteHD',id=f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf2cd49a3d45329dfea301153fcb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:24Z,use_quota=True,user_id='80fd2c4adef042ee887da95bed991608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f8fd389-9b46-409c-bee5-7399a0b44c36),volume_type_id=9f8fd389-9b46-409c-bee5-7399a0b44c36)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca33fc7b-fb0d-4d5e-b331-b80e92aae2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca33fc7b-fb0d-4d5e-b331-b80e92aae2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3541d485-ca8e-4f74-b4a0-87040dc93b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3541d485-ca8e-4f74-b4a0-87040dc93b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c', 'volume_name': 'volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554fbe70-752c-4d53-8180-18de3cae1bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554fbe70-752c-4d53-8180-18de3cae1bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc08bba-91d3-46e9-b00c-fc3dd20ac625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Volume f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c', 'volume_size': 1} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8126f7b3-f34f-42e7-a27b-f6e54d44d36d,created_at=2026-09-22T22:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1418598932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8126f7b3-f34f-42e7-a27b-f6e54d44d36d,host='devstack@QuobyteHD#QuobyteHD',id=f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf2cd49a3d45329dfea301153fcb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:24Z,use_quota=True,user_id='80fd2c4adef042ee887da95bed991608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f8fd389-9b46-409c-bee5-7399a0b44c36),volume_type_id=9f8fd389-9b46-409c-bee5-7399a0b44c36)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Creating volume f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:24 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:24 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c 1073741824 Sep 23 00:30:24 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Flow 'volume_create_manager' (cc6ebb34-c060-445b-8083-a4d0e0bfa4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56f8731-bb59-479e-a104-7cde47b7ea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56f8731-bb59-479e-a104-7cde47b7ea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f495029-74a1-4ea6-bfda-ed20aac038a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69637b694c9849288e127907d6c71199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:25Z,use_quota=True,user_id='4ea22a2379b7489997ddc15b5ddda7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3d81596-8a30-4887-9b83-33180db6834f),volume_type_id=f3d81596-8a30-4887-9b83-33180db6834f)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07db4a0-2a3e-4960-bd29-cff196851b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07db4a0-2a3e-4960-bd29-cff196851b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbb79c7-1f5f-48c6-9c7b-a16b7f5cb359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:24 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:30:25 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c 1073741824" returned: 0 in 0.892s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:25 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c Sep 23 00:30:25 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:26 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" returned: 0 in 0.620s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc08bba-91d3-46e9-b00c-fc3dd20ac625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25099c14-9c07-4c3a-9fb7-b6bf585d4c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbb79c7-1f5f-48c6-9c7b-a16b7f5cb359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f495029-74a1-4ea6-bfda-ed20aac038a3', 'volume_name': 'volume-5f495029-74a1-4ea6-bfda-ed20aac038a3', 'volume_size': 1, 'image_id': '86f6bfde-2390-4072-9800-42d0fc6e43bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86f6bfde-2390-4072-9800-42d0fc6e43bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ebfd72b2c0b9dfe676f13cac9c43b8e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69637b694c9849288e127907d6c71199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69f61c1f094e157b6d70a0bebdacb9648af623587ebe068a0ded52cbf315ee820759197f45143805223ed9bce996e183a14a0059c3b34a07a5d4e78316415b8d', 'id': '86f6bfde-2390-4072-9800-42d0fc6e43bf', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86f6bfde-2390-4072-9800-42d0fc6e43bf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dad0ca-866c-42ed-a52a-a64cb5b3abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23dad0ca-866c-42ed-a52a-a64cb5b3abde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e320f2-241a-4360-894e-6d70b9ba78d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Volume 5f495029-74a1-4ea6-bfda-ed20aac038a3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f495029-74a1-4ea6-bfda-ed20aac038a3', 'volume_size': 1, 'image_id': '86f6bfde-2390-4072-9800-42d0fc6e43bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86f6bfde-2390-4072-9800-42d0fc6e43bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ebfd72b2c0b9dfe676f13cac9c43b8e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69637b694c9849288e127907d6c71199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69f61c1f094e157b6d70a0bebdacb9648af623587ebe068a0ded52cbf315ee820759197f45143805223ed9bce996e183a14a0059c3b34a07a5d4e78316415b8d', 'id': '86f6bfde-2390-4072-9800-42d0fc6e43bf', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86f6bfde-2390-4072-9800-42d0fc6e43bf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Trying to clone 5f495029-74a1-4ea6-bfda-ed20aac038a3 from image 86f6bfde-2390-4072-9800-42d0fc6e43bf at location (None, [{'url': 'file:///opt/stack/data/glance/images/86f6bfde-2390-4072-9800-42d0fc6e43bf', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:30:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Volume volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c (f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c): created successfully Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25099c14-9c07-4c3a-9fb7-b6bf585d4c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Flow 'volume_create_manager' (71bc3b22-fdcd-4d13-a05d-8885b352f6c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-99ad11eb-cc4a-44dd-b5ee-866fb9dbcaca tempest-GroupSnapshotsTest-2125997571 None] Created volume successfully. Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:30:26 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95513dc-0857-4778-b161-df258b4f4424]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:26 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD Sep 23 00:30:26 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:26 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:27 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD Sep 23 00:30:27 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:27 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD" returned: 1 in 0.507s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:30:27 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Temporary image 86f6bfde-2390-4072-9800-42d0fc6e43bf is fetched for user 4ea22a2379b7489997ddc15b5ddda7cd. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:30:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f169c916-dc0d-49d3-86c1-a1718adca34b]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:27 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD Sep 23 00:30:27 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:28 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:28 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD Sep 23 00:30:28 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Flow 'volume_create_manager' (83aff0f3-45ce-4af0-9bec-7523c51991ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a693dc-40fb-456e-8a19-6184347daed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a693dc-40fb-456e-8a19-6184347daed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1039740862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8126f7b3-f34f-42e7-a27b-f6e54d44d36d,host='devstack@QuobyteHD#QuobyteHD',id=82690399-4a0b-4466-8e7b-2f80f6dde716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf2cd49a3d45329dfea301153fcb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:28Z,use_quota=True,user_id='80fd2c4adef042ee887da95bed991608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f8fd389-9b46-409c-bee5-7399a0b44c36),volume_type_id=9f8fd389-9b46-409c-bee5-7399a0b44c36)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78d039c-ffe6-49c6-8948-03a4cb149b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78d039c-ffe6-49c6-8948-03a4cb149b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d391875c-acf6-4c74-be6c-782abe61e596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d391875c-acf6-4c74-be6c-782abe61e596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82690399-4a0b-4466-8e7b-2f80f6dde716', 'volume_name': 'volume-82690399-4a0b-4466-8e7b-2f80f6dde716', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11564ad-c2da-4542-864d-82b308cd3c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d11564ad-c2da-4542-864d-82b308cd3c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b31167-c992-4a4e-a759-0fb14b50015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Volume 82690399-4a0b-4466-8e7b-2f80f6dde716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82690399-4a0b-4466-8e7b-2f80f6dde716', 'volume_size': 1} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8126f7b3-f34f-42e7-a27b-f6e54d44d36d,created_at=2026-09-22T22:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1039740862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8126f7b3-f34f-42e7-a27b-f6e54d44d36d,host='devstack@QuobyteHD#QuobyteHD',id=82690399-4a0b-4466-8e7b-2f80f6dde716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf2cd49a3d45329dfea301153fcb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:28Z,use_quota=True,user_id='80fd2c4adef042ee887da95bed991608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f8fd389-9b46-409c-bee5-7399a0b44c36),volume_type_id=9f8fd389-9b46-409c-bee5-7399a0b44c36)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Creating volume 82690399-4a0b-4466-8e7b-2f80f6dde716 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:28 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:28 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 1073741824 Sep 23 00:30:28 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (1e02bbcd-f7f8-455d-9aea-ecccb7ff4c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6affbf-5e62-4b3e-82fe-5296eb794f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6affbf-5e62-4b3e-82fe-5296eb794f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1759826867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65048262-3867-456f-b3d1-6df55127b278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:28Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eafb7e-9212-4043-9855-b8b82953cae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30eafb7e-9212-4043-9855-b8b82953cae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a809730b-e70e-4882-a1ba-e102bf320c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a809730b-e70e-4882-a1ba-e102bf320c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65048262-3867-456f-b3d1-6df55127b278', 'volume_name': 'volume-65048262-3867-456f-b3d1-6df55127b278', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671c8df4-751b-49d4-9ab9-02e6f5b728c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671c8df4-751b-49d4-9ab9-02e6f5b728c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b92ae4-ada3-4fba-bea1-daf328e31941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Volume 65048262-3867-456f-b3d1-6df55127b278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65048262-3867-456f-b3d1-6df55127b278', 'volume_size': 1} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD" returned: 1 in 0.613s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (dcbb98b9-e90c-46cd-8f5a-e8f031a091a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0296ea76-f0fd-448e-92e8-c67023094571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0296ea76-f0fd-448e-92e8-c67023094571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-13181996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9197b2c0-80bd-411c-9583-d1db53be7c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:29Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ec1745-31c5-415b-928d-82dc70b231cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2ec1745-31c5-415b-928d-82dc70b231cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aec675-92f0-49e7-914f-2b68cc953bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aec675-92f0-49e7-914f-2b68cc953bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9197b2c0-80bd-411c-9583-d1db53be7c4b', 'volume_name': 'volume-9197b2c0-80bd-411c-9583-d1db53be7c4b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e13758-6c69-4345-b8ee-6ab51715f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e13758-6c69-4345-b8ee-6ab51715f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a056823-281b-4045-acaf-10d5d5920c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Volume 9197b2c0-80bd-411c-9583-d1db53be7c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9197b2c0-80bd-411c-9583-d1db53be7c4b', 'volume_size': 1} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:29 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 1073741824" returned: 0 in 0.784s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:29 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 Sep 23 00:30:29 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (28255502-a654-49c9-935f-c2695df93a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f86bb72-91b6-44ef-a979-3e2b1930ad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f86bb72-91b6-44ef-a979-3e2b1930ad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281821954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d83d13-c044-400f-8e99-ae0e52dfd6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:30Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c71856-4e14-4045-8c57-50d1a05b7ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16c71856-4e14-4045-8c57-50d1a05b7ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee2f70d-3ee5-402d-9878-5859e2d99207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee2f70d-3ee5-402d-9878-5859e2d99207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d83d13-c044-400f-8e99-ae0e52dfd6dd', 'volume_name': 'volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbbec3c-075c-431e-aaec-7607eaab0029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbbec3c-075c-431e-aaec-7607eaab0029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9d201e-efe1-4352-af7e-f9a8ac08de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Volume 44d83d13-c044-400f-8e99-ae0e52dfd6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd', 'volume_size': 1} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:29 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716" returned: 0 in 0.372s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.026s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1759826867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65048262-3867-456f-b3d1-6df55127b278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:28Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Creating volume 65048262-3867-456f-b3d1-6df55127b278 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:29 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b31167-c992-4a4e-a759-0fb14b50015e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82690399-4a0b-4466-8e7b-2f80f6dde716', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278 1073741824 Sep 23 00:30:29 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be9b3f3-10df-4cf2-9973-3350dcc064d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:29 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Volume volume-82690399-4a0b-4466-8e7b-2f80f6dde716 (82690399-4a0b-4466-8e7b-2f80f6dde716): created successfully Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be9b3f3-10df-4cf2-9973-3350dcc064d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Flow 'volume_create_manager' (83aff0f3-45ce-4af0-9bec-7523c51991ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8fb76f59-b9f5-4f7b-9c56-ccc6c5f5a7d1 tempest-GroupSnapshotsTest-2125997571 None] Created volume successfully. Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (e9d74e0f-0457-4e42-a37b-59c659b2a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221a3c85-7942-4cbc-acb6-1b9876a09e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221a3c85-7942-4cbc-acb6-1b9876a09e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270436886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:30Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbe8fca-2616-4acd-b0ea-f2e7da5045e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbe8fca-2616-4acd-b0ea-f2e7da5045e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88076df2-a024-4fa8-b646-c18d804436c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88076df2-a024-4fa8-b646-c18d804436c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818', 'volume_name': 'volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8a9494-6236-4d48-b277-955631354fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8a9494-6236-4d48-b277-955631354fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4823af30-888d-4988-973a-5b5aa49cf75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Volume 4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818', 'volume_size': 1} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:30 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278 1073741824" returned: 0 in 0.678s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:30 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278 Sep 23 00:30:30 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (6b999c2b-b6b3-4970-9c37-cc3b075ad2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7c76d0-d64f-49b2-88d6-0c15ca0c6fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7c76d0-d64f-49b2-88d6-0c15ca0c6fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905476821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d99eec-a150-476c-b394-ee732287cb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:31Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ebd49a-30be-408c-bb75-7126d132b1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ebd49a-30be-408c-bb75-7126d132b1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147fb06b-7cbe-4fa1-ab9b-7b3592244567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (147fb06b-7cbe-4fa1-ab9b-7b3592244567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97d99eec-a150-476c-b394-ee732287cb55', 'volume_name': 'volume-97d99eec-a150-476c-b394-ee732287cb55', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00f04db-05e7-4523-96c9-b357f237a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00f04db-05e7-4523-96c9-b357f237a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6850acd2-b759-4d61-83c0-946e9b854d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Volume 97d99eec-a150-476c-b394-ee732287cb55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97d99eec-a150-476c-b394-ee732287cb55', 'volume_size': 1} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:30 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278" returned: 0 in 0.349s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.125s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f495029-74a1-4ea6-bfda-ed20aac038a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69637b694c9849288e127907d6c71199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:25Z,use_quota=True,user_id='4ea22a2379b7489997ddc15b5ddda7cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f3d81596-8a30-4887-9b83-33180db6834f),volume_type_id=f3d81596-8a30-4887-9b83-33180db6834f)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Creating volume 5f495029-74a1-4ea6-bfda-ed20aac038a3 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:30 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:30 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 1073741824 Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b92ae4-ada3-4fba-bea1-daf328e31941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65048262-3867-456f-b3d1-6df55127b278', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2606b8-e443-4f24-bee9-307d596f47f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:30 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Volume volume-65048262-3867-456f-b3d1-6df55127b278 (65048262-3867-456f-b3d1-6df55127b278): created successfully Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e2606b8-e443-4f24-bee9-307d596f47f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (1e02bbcd-f7f8-455d-9aea-ecccb7ff4c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:30 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-aeca77b3-dfa6-4289-b69c-36397619fd76 tempest-GroupSnapshotsTest-2125997571 None] Update group completed successfully. Sep 23 00:30:30 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c9c8a773-2efc-476a-bf55-a8352f552aaf tempest-CreateVolumesFromImageTest-1970909805 None] Created volume successfully. Sep 23 00:30:31 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 1073741824" returned: 0 in 0.493s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:31 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 Sep 23 00:30:31 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:31 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3" returned: 0 in 0.282s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.596s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-13181996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9197b2c0-80bd-411c-9583-d1db53be7c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:29Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Creating volume 9197b2c0-80bd-411c-9583-d1db53be7c4b {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:31 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:31 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b 1073741824 Sep 23 00:30:31 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Attempting download of 86f6bfde-2390-4072-9800-42d0fc6e43bf ((None, [{'url': 'file:///opt/stack/data/glance/images/86f6bfde-2390-4072-9800-42d0fc6e43bf', 'metadata': {}}])) to volume 5f495029-74a1-4ea6-bfda-ed20aac038a3. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f29eba0-c1dc-4258-ab16-1a813b8187e8]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86f6bfde-2390-4072-9800-42d0fc6e43bf_igfnn_9e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:32 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86f6bfde-2390-4072-9800-42d0fc6e43bf_igfnn_9e Sep 23 00:30:32 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8e8219c1-6db9-415e-9cca-b6f7620830f9 tempest-GroupSnapshotsTest-2125997571 None] Update group completed successfully. Sep 23 00:30:32 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b 1073741824" returned: 0 in 0.600s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:32 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86f6bfde-2390-4072-9800-42d0fc6e43bf_igfnn_9e" returned: 0 in 0.522s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86f6bfde-2390-4072-9800-42d0fc6e43bf_igfnn_9e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:32 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b Sep 23 00:30:32 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:32 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86f6bfde-2390-4072-9800-42d0fc6e43bf_igfnn_9e Sep 23 00:30:32 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:32 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b" returned: 0 in 0.360s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281821954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d83d13-c044-400f-8e99-ae0e52dfd6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:30Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Creating volume 44d83d13-c044-400f-8e99-ae0e52dfd6dd {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:32 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:32 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86f6bfde-2390-4072-9800-42d0fc6e43bf_igfnn_9e" returned: 1 in 0.473s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86f6bfde-2390-4072-9800-42d0fc6e43bf_igfnn_9e' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:30:32 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd 1073741824 Sep 23 00:30:32 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a056823-281b-4045-acaf-10d5d5920c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9197b2c0-80bd-411c-9583-d1db53be7c4b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7b3141-3608-42f8-a5fa-4b2cae1e1b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e8c1cd-b219-49ac-8a42-95b80046f59a]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:32 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Volume volume-9197b2c0-80bd-411c-9583-d1db53be7c4b (9197b2c0-80bd-411c-9583-d1db53be7c4b): created successfully Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7b3141-3608-42f8-a5fa-4b2cae1e1b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (dcbb98b9-e90c-46cd-8f5a-e8f031a091a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:32 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD Sep 23 00:30:32 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-26ca63b8-7a3d-4212-85a1-492140ed1d78 tempest-CreateVolumesFromImageTest-1970909805 None] Created volume successfully. Sep 23 00:30:33 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1fefd122-8779-46fd-9aa9-871a1ef40fbf tempest-GroupSnapshotsTest-2125997571 None] Update group completed successfully. Sep 23 00:30:33 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd 1073741824" returned: 0 in 0.666s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:33 devstack sudo[103707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD Sep 23 00:30:33 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:33 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd Sep 23 00:30:33 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:33 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] 86f6bfde-2390-4072-9800-42d0fc6e43bf was raw, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:33 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 Sep 23 00:30:33 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:33 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.538s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270436886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:30Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Creating volume 4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:33 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:33 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 1073741824 Sep 23 00:30:33 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9d201e-efe1-4352-af7e-f9a8ac08de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a52ab2-2b56-412b-9723-237659574e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:34 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Volume volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd (44d83d13-c044-400f-8e99-ae0e52dfd6dd): created successfully Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a52ab2-2b56-412b-9723-237659574e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (28255502-a654-49c9-935f-c2695df93a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:34 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4fd988ae-b434-4e8b-83e3-abec0c8ddc82 tempest-CreateVolumesFromImageTest-1970909805 None] Created volume successfully. Sep 23 00:30:34 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3" returned: 0 in 0.647s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86f6bfde-2390-4072-9800-42d0fc6e43bf_mvdzb8kddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:30:34 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:34 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 1G Sep 23 00:30:34 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:34 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 1073741824" returned: 0 in 0.655s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:34 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 Sep 23 00:30:34 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:34 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-967639bf-dacc-41cf-bd22-bc15f7e338ce tempest-GroupSnapshotsTest-2125997571 None] Update group completed successfully. Sep 23 00:30:34 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 1G" returned: 0 in 0.396s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Downloaded image 86f6bfde-2390-4072-9800-42d0fc6e43bf ((None, [{'url': 'file:///opt/stack/data/glance/images/86f6bfde-2390-4072-9800-42d0fc6e43bf', 'metadata': {}}])) to volume 5f495029-74a1-4ea6-bfda-ed20aac038a3 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Temporary image 86f6bfde-2390-4072-9800-42d0fc6e43bf for user 4ea22a2379b7489997ddc15b5ddda7cd is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Marking volume 5f495029-74a1-4ea6-bfda-ed20aac038a3 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Copying metadata from image 86f6bfde-2390-4072-9800-42d0fc6e43bf to 5f495029-74a1-4ea6-bfda-ed20aac038a3. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Creating volume glance metadata for volume 5f495029-74a1-4ea6-bfda-ed20aac038a3 backed by image 86f6bfde-2390-4072-9800-42d0fc6e43bf with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '86f6bfde-2390-4072-9800-42d0fc6e43bf', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3ebfd72b2c0b9dfe676f13cac9c43b8e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:30:34 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818" returned: 0 in 0.355s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.141s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-905476821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97d99eec-a150-476c-b394-ee732287cb55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb06d83b2c394798a233ffbd394a0563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:31Z,use_quota=True,user_id='3b0e4b884a834a209bbbf68a31e7d676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Creating volume 97d99eec-a150-476c-b394-ee732287cb55 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:34 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4823af30-888d-4988-973a-5b5aa49cf75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:35 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55 1073741824 Sep 23 00:30:35 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590e0adb-a360-4378-bd78-8b7be2409073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e320f2-241a-4360-894e-6d70b9ba78d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f495029-74a1-4ea6-bfda-ed20aac038a3', 'volume_size': 1, 'image_id': '86f6bfde-2390-4072-9800-42d0fc6e43bf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86f6bfde-2390-4072-9800-42d0fc6e43bf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3ebfd72b2c0b9dfe676f13cac9c43b8e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '69637b694c9849288e127907d6c71199', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69f61c1f094e157b6d70a0bebdacb9648af623587ebe068a0ded52cbf315ee820759197f45143805223ed9bce996e183a14a0059c3b34a07a5d4e78316415b8d', 'id': '86f6bfde-2390-4072-9800-42d0fc6e43bf', 'created_at': datetime.datetime(2026, 9, 22, 22, 30, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 30, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86f6bfde-2390-4072-9800-42d0fc6e43bf/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bfb8f5-c64a-4939-bb5e-cc802e2a19c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Volume volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 (4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818): created successfully Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (590e0adb-a360-4378-bd78-8b7be2409073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (e9d74e0f-0457-4e42-a37b-59c659b2a94a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Volume volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 (5f495029-74a1-4ea6-bfda-ed20aac038a3): created successfully Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bfb8f5-c64a-4939-bb5e-cc802e2a19c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Flow 'volume_create_manager' (cc6ebb34-c060-445b-8083-a4d0e0bfa4a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6f7aeed2-4940-41e7-a8de-05d44d911699 tempest-CreateVolumesFromImageTest-1970909805 None] Created volume successfully. Sep 23 00:30:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f1b877b1-ffe7-4905-957c-15d0180c47e4 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Created volume successfully. Sep 23 00:30:35 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55 1073741824" returned: 0 in 0.658s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:35 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55 Sep 23 00:30:35 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:36 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55" returned: 0 in 0.323s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6850acd2-b759-4d61-83c0-946e9b854d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97d99eec-a150-476c-b394-ee732287cb55', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce1a82c-7e67-49c0-a45c-4dd37957b320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:36 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Volume volume-97d99eec-a150-476c-b394-ee732287cb55 (97d99eec-a150-476c-b394-ee732287cb55): created successfully Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce1a82c-7e67-49c0-a45c-4dd37957b320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Flow 'volume_create_manager' (6b999c2b-b6b3-4970-9c37-cc3b075ad2f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-54d3b323-2b19-4e03-911e-89aad864955e tempest-CreateVolumesFromImageTest-1970909805 None] Created volume successfully. Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Acquiring lock "cinder-5f495029-74a1-4ea6-bfda-ed20aac038a3-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "cinder-5f495029-74a1-4ea6-bfda-ed20aac038a3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Acquiring lock "cinder-quobyte-5f495029-74a1-4ea6-bfda-ed20aac038a3" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "cinder-quobyte-5f495029-74a1-4ea6-bfda-ed20aac038a3" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf55b71-8d23-40ec-b333-7ebb6dc97722]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] GroupSnapshot 2c7b2d6d-4b0d-46c6-9b7f-adf87ac3c413: creating. Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Group snapshot 2c7b2d6d-4b0d-46c6-9b7f-adf87ac3c413: creating. {{(pid=87138) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Creating offline snapshot 78b8c83f-4572-4af6-a5e4-e11da169be7f of volume 82690399-4a0b-4466-8e7b-2f80f6dde716 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-97d99eec-a150-476c-b394-ee732287cb55-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eceba7-50fe-4717-952a-c0b09ac375a9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-97d99eec-a150-476c-b394-ee732287cb55-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:36 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 Sep 23 00:30:36 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-quobyte-97d99eec-a150-476c-b394-ee732287cb55" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-97d99eec-a150-476c-b394-ee732287cb55" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e39e00-0e60-4aa4-86b4-3e263b0bb7be]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:36 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 Sep 23 00:30:36 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:36 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55 Sep 23 00:30:36 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:36 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3" returned: 0 in 0.623s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:37 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3 Sep 23 00:30:37 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:37 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716" returned: 0 in 0.575s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:37 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f 1G Sep 23 00:30:37 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:37 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55" returned: 0 in 0.548s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:37 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55 Sep 23 00:30:37 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:37 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5f495029-74a1-4ea6-bfda-ed20aac038a3" returned: 0 in 0.412s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "cinder-quobyte-5f495029-74a1-4ea6-bfda-ed20aac038a3" released by "delete_volume" :: held 1.115s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:37 devstack cinder-volume[87138]: WARNING cinder.quota [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:37 devstack cinder-volume[87138]: WARNING cinder.quota [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Created reservations ['f00e0acb-75a0-4819-b47d-6de24db2194a', 'bdfa4049-982d-4e96-826f-efdd3c716cf4', '6220feaf-ab8e-4e28-bd01-0420b959711d', '9a99143d-5a05-46f6-b583-cf2635f3cb2c', '50c49db5-f088-42f2-896e-fb939ba16872'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:37 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-97d99eec-a150-476c-b394-ee732287cb55" returned: 0 in 0.387s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-97d99eec-a150-476c-b394-ee732287cb55" released by "delete_volume" :: held 1.003s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:37 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f 1G" returned: 0 in 0.659s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:37 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82690399-4a0b-4466-8e7b-2f80f6dde716 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:37 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:37 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82690399-4a0b-4466-8e7b-2f80f6dde716 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f Sep 23 00:30:37 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Created reservations ['040b0b8b-54a2-45c1-b693-976eccfbc8f5', '1e8807f6-74e3-4e6b-a364-215c9b597386', 'fdccf934-8008-4b39-a655-a626164b022a', 'a1214081-03b9-42a0-b6d9-23498eebdd1c', '6bc4067b-8c2f-4c11-970c-34566d01e8cc'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:37 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:37 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:38 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.371s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:38 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Deleted volume successfully. Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-52da74cc-ab3d-4927-9b78-071a29d29940 tempest-VolumeAndVolumeTypeFromImageTest-370319888 None] Lock "cinder-5f495029-74a1-4ea6-bfda-ed20aac038a3-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:38 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82690399-4a0b-4466-8e7b-2f80f6dde716 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f" returned: 0 in 0.452s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:38 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:38 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f Sep 23 00:30:38 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:38 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.346s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:38 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Deleted volume successfully. Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c5ada26b-8ada-4629-ab03-d24ccb0a02be tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-97d99eec-a150-476c-b394-ee732287cb55-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:38 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f" returned: 0 in 0.399s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:38 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.info Sep 23 00:30:38 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-quobyte-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b190b-0928-4c38-86e4-776475e08f29]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:39 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.info" returned: 0 in 0.432s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:39 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:39 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.info Sep 23 00:30:39 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:39 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 Sep 23 00:30:39 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:39 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.info" returned: 0 in 0.376s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.032s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:39 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818" returned: 0 in 0.535s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Creating offline snapshot 99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 of volume f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:30:39 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818 Sep 23 00:30:39 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb3ef11-b83e-47bf-ba52-eff292c4d8f1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:39 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c Sep 23 00:30:39 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:39 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818" returned: 0 in 0.369s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818" released by "delete_volume" :: held 0.990s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Created reservations ['46827442-ec6f-4c61-b153-9780de4bfadc', 'f0420abb-b879-426c-80a9-326d1a3643b8', '254ed5fc-529e-498f-aa85-8aa7dd4019ab', '0cd50803-d45d-4021-be74-2a4a585bc956', '1990090f-4d3d-40d3-b00a-041772952886'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:40 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" returned: 0 in 0.644s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:40 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:40 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:40 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 1G Sep 23 00:30:40 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:40 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.314s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Deleted volume successfully. Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a3814a8c-0794-49b7-a546-a72b2287e603 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-4e5b6f6e-2ed4-4e2d-84ca-685efb4bf818-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:40 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 1G" returned: 0 in 0.609s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:40 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 Sep 23 00:30:40 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:41 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5" returned: 0 in 0.445s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:41 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-44d83d13-c044-400f-8e99-ae0e52dfd6dd-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:41 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 Sep 23 00:30:41 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-44d83d13-c044-400f-8e99-ae0e52dfd6dd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-quobyte-44d83d13-c044-400f-8e99-ae0e52dfd6dd" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-44d83d13-c044-400f-8e99-ae0e52dfd6dd" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab67f6d1-3b4e-4309-9163-7fc874e96c0d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:41 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd Sep 23 00:30:41 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:41 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5" returned: 0 in 0.396s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:41 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.info Sep 23 00:30:41 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:42 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd" returned: 0 in 0.559s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd Sep 23 00:30:42 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:42 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.info" returned: 0 in 0.443s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:42 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.info Sep 23 00:30:42 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:42 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-44d83d13-c044-400f-8e99-ae0e52dfd6dd" returned: 0 in 0.372s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-44d83d13-c044-400f-8e99-ae0e52dfd6dd" released by "delete_volume" :: held 1.024s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Created reservations ['7d5c7356-2bee-4096-bb71-e1f5e4cc6907', '29df791c-398f-4649-8148-459604c4cead', 'c8b36800-0d73-4b6e-bb2f-252a6c27a6a4', 'bb6ace3c-da55-40a9-b862-342af891b2d4', '0489999f-c8cb-4b5d-9821-23c7e648399f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:42 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.info" returned: 0 in 0.388s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.085s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:42 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:42 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:42 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fb0a36ad-a08f-4923-9d9f-b9ad76e898bf tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 2c7b2d6d-4b0d-46c6-9b7f-adf87ac3c413: created successfully Sep 23 00:30:43 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.330s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:43 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Deleted volume successfully. Sep 23 00:30:43 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 2c7b2d6d-4b0d-46c6-9b7f-adf87ac3c413: deleting Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ff7dc3a7-e63b-42d9-9d8f-c86eb05e6a84 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-44d83d13-c044-400f-8e99-ae0e52dfd6dd-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 2c7b2d6d-4b0d-46c6-9b7f-adf87ac3c413: deleting {{(pid=87138) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-82690399-4a0b-4466-8e7b-2f80f6dde716" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-82690399-4a0b-4466-8e7b-2f80f6dde716" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-78b8c83f-4572-4af6-a5e4-e11da169be7f" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-78b8c83f-4572-4af6-a5e4-e11da169be7f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Deleting offline snapshot 78b8c83f-4572-4af6-a5e4-e11da169be7f of volume 82690399-4a0b-4466-8e7b-2f80f6dde716 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] snapshot_file for this snap is: volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c9cf23-784f-4e57-baf0-12197bcf9779]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:43 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f Sep 23 00:30:43 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-9197b2c0-80bd-411c-9583-d1db53be7c4b-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-9197b2c0-80bd-411c-9583-d1db53be7c4b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-quobyte-9197b2c0-80bd-411c-9583-d1db53be7c4b" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-9197b2c0-80bd-411c-9583-d1db53be7c4b" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[380b6e17-a456-450a-807b-31b1ef716d96]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:43 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f" returned: 0 in 0.595s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82690399-4a0b-4466-8e7b-2f80f6dde716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:43 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b Sep 23 00:30:43 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c96724-0a5e-424d-b786-01c1e548b83d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:44 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 Sep 23 00:30:44 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:44 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b" returned: 0 in 0.474s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:44 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b Sep 23 00:30:44 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:44 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716" returned: 0 in 0.585s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:44 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9197b2c0-80bd-411c-9583-d1db53be7c4b" returned: 0 in 0.329s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-9197b2c0-80bd-411c-9583-d1db53be7c4b" released by "delete_volume" :: held 0.879s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:44 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f Sep 23 00:30:44 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Created reservations ['ea3aded1-5d49-4931-8bb4-b52f63bef9e4', '3757898f-aa7a-405b-ada4-2c1b54147891', '32432729-4bd7-4d18-b546-95b0a204e4b2', 'e88c63e3-ae56-4475-8dd0-797f86593a3d', 'e460d583-f47b-4066-8689-2eededc8c48b'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:44 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:44 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-65048262-3867-456f-b3d1-6df55127b278-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-65048262-3867-456f-b3d1-6df55127b278-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "cinder-quobyte-65048262-3867-456f-b3d1-6df55127b278" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-65048262-3867-456f-b3d1-6df55127b278" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7db1f01-503d-4ba5-8f09-fea3eabcdd18]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:45 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f" returned: 0 in 0.644s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:45 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f Sep 23 00:30:45 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.442s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:45 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278 Sep 23 00:30:45 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Deleted volume successfully. Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-87f26c21-862e-41a4-ab4e-f5a14b16fb3e tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-9197b2c0-80bd-411c-9583-d1db53be7c4b-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:45 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278" returned: 0 in 0.513s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716.78b8c83f-4572-4af6-a5e4-e11da169be7f" returned: 0 in 0.475s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:45 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278 Sep 23 00:30:45 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-78b8c83f-4572-4af6-a5e4-e11da169be7f" released by "_delete_snapshot" :: held 2.511s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-82690399-4a0b-4466-8e7b-2f80f6dde716" released by "delete_snapshot" :: held 2.552s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Deleting offline snapshot 99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 of volume f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] snapshot_file for this snap is: volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bab9851-a330-4db4-a02f-f5602ecb1562]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:46 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-65048262-3867-456f-b3d1-6df55127b278" returned: 0 in 0.358s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-quobyte-65048262-3867-456f-b3d1-6df55127b278" released by "delete_volume" :: held 0.956s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:46 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 Sep 23 00:30:46 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Created reservations ['c7867219-add3-495d-aba1-404886d5eacc', '8b0ff420-a963-4fa9-bac4-4fa414a28a50', '566708da-bf62-4749-ac98-61d152f4a23b', 'bf85ae1d-eaf7-4a84-8851-40f328397452', 'a43f4a34-7e8a-4d2f-a9b2-3cc132fa435d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (ed47836f-9074-4aef-8591-272409a0a19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e144502b-c2f8-4384-a5c7-29afee7de83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e144502b-c2f8-4384-a5c7-29afee7de83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789010952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688bf7d9-e62d-466e-b66b-eff95c230900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:46Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aab77c-645c-46f0-97b4-9f5209a1ea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2aab77c-645c-46f0-97b4-9f5209a1ea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c46db4-0a81-486e-8e86-8e7f3c9c7125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79c46db4-0a81-486e-8e86-8e7f3c9c7125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '688bf7d9-e62d-466e-b66b-eff95c230900', 'volume_name': 'volume-688bf7d9-e62d-466e-b66b-eff95c230900', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85174e6e-e834-4830-9e5a-c0fe7bc0d158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85174e6e-e834-4830-9e5a-c0fe7bc0d158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b03d603-359c-45b5-bbe5-96456f2854d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:46 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume 688bf7d9-e62d-466e-b66b-eff95c230900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-688bf7d9-e62d-466e-b66b-eff95c230900', 'volume_size': 1} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1789010952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=688bf7d9-e62d-466e-b66b-eff95c230900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:46Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Creating volume 688bf7d9-e62d-466e-b66b-eff95c230900 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:46 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:46 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:46 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900 1073741824 Sep 23 00:30:46 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5" returned: 0 in 0.552s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:30:46 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:46 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebcf470-64b4-46d6-b3bf-d646be115b0f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:46 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c Sep 23 00:30:46 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:46 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.326s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Deleted volume successfully. Sep 23 00:30:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-379b4d4b-e095-4a05-81a6-2c35d8d5c754 tempest-CreateVolumesFromImageTest-1970909805 None] Lock "cinder-65048262-3867-456f-b3d1-6df55127b278-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:47 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" returned: 0 in 0.515s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:47 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900 1073741824" returned: 0 in 0.656s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 Sep 23 00:30:47 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:47 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900 Sep 23 00:30:47 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:47 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900" returned: 0 in 0.299s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b03d603-359c-45b5-bbe5-96456f2854d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-688bf7d9-e62d-466e-b66b-eff95c230900', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa47260-898f-402e-bef3-a28ab6dc03c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:47 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume volume-688bf7d9-e62d-466e-b66b-eff95c230900 (688bf7d9-e62d-466e-b66b-eff95c230900): created successfully Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa47260-898f-402e-bef3-a28ab6dc03c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (ed47836f-9074-4aef-8591-272409a0a19b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:47 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5" returned: 0 in 0.455s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f5b3468a-b7b0-49bc-9c27-e6eac912bfac tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created volume successfully. Sep 23 00:30:47 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5 Sep 23 00:30:47 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:47 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c.99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5" returned: 0 in 0.340s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-99b0ce35-2aa3-47a1-b747-6ddf7cedb7f5" released by "_delete_snapshot" :: held 2.006s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" released by "delete_snapshot" :: held 2.038s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:47 devstack cinder-volume[87138]: WARNING cinder.quota [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1185464662 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1185464662, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:47 devstack cinder-volume[87138]: WARNING cinder.quota [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1185464662 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1185464662, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:48 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['2d7f4a52-4bdf-4356-97b8-dabd89ba3a70', '371f2599-ba2e-4662-b33a-53100cf786b9', '02049d37-865d-455f-9ce1-f7c3e22674b9', '1dc0ebed-8942-4cdb-8171-dedf3bd5897d', '83fa085a-604b-4750-8b0c-aca076352f44'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:48 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['2e1a1689-c976-4f6e-a9d3-f19575cff1f8', 'b9dba0ed-cb15-427d-97fc-5855ed873e19', '96990d88-768f-4ef3-9ea0-a6cdcd7413b4', 'c7fc7d73-7a90-4958-a54d-013a5ce3fe37', '03da5e6f-5d9b-498f-bdda-65f35abac32d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:48 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8ada11e1-a892-437a-9fc3-099bcdb90723 tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 2c7b2d6d-4b0d-46c6-9b7f-adf87ac3c413: deleted successfully Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (4eb733df-9e9c-482c-b654-675317573cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28254763-7dec-41d8-a7a3-807997d9542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28254763-7dec-41d8-a7a3-807997d9542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866204222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6a5c12-515f-46a9-9130-144689266e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:49Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c2c49d-3b35-4dad-8419-87dad4ae123a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c2c49d-3b35-4dad-8419-87dad4ae123a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d0c872-0e62-4454-ba44-8bb9e4a0be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99d0c872-0e62-4454-ba44-8bb9e4a0be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6a5c12-515f-46a9-9130-144689266e80', 'volume_name': 'volume-0a6a5c12-515f-46a9-9130-144689266e80', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce35eecb-4257-43bb-8d56-6173f6f49c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce35eecb-4257-43bb-8d56-6173f6f49c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed432c6b-e428-4b0e-b170-978793cec136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:49 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume 0a6a5c12-515f-46a9-9130-144689266e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6a5c12-515f-46a9-9130-144689266e80', 'volume_size': 1} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866204222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6a5c12-515f-46a9-9130-144689266e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:49Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Creating volume 0a6a5c12-515f-46a9-9130-144689266e80 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:49 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:49 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80 1073741824 Sep 23 00:30:49 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-82690399-4a0b-4466-8e7b-2f80f6dde716" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-82690399-4a0b-4466-8e7b-2f80f6dde716" acquired by "delete_volume" :: waited 0.044s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c41f6f-9163-4821-99f2-7512836f9b85]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:50 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 Sep 23 00:30:50 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (4a404359-ca3a-4564-b85c-bbd87b48c22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e888d3-414a-4c0e-8721-9c7e57c6821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e888d3-414a-4c0e-8721-9c7e57c6821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1699171644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8b33e1-170f-4811-a942-dda260b06137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:50Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9ec2a3-d121-4fff-8225-f4e31bf2525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd9ec2a3-d121-4fff-8225-f4e31bf2525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c7e9e9-be2b-45da-9863-3d34048ac555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c7e9e9-be2b-45da-9863-3d34048ac555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8b33e1-170f-4811-a942-dda260b06137', 'volume_name': 'volume-df8b33e1-170f-4811-a942-dda260b06137', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9b1ef3-ce58-4c06-a869-05230d1862f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9b1ef3-ce58-4c06-a869-05230d1862f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5861028c-ad28-4247-a9d0-9d184e83fd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:50 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume df8b33e1-170f-4811-a942-dda260b06137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8b33e1-170f-4811-a942-dda260b06137', 'volume_size': 1} Sep 23 00:30:50 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80 1073741824" returned: 0 in 0.808s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:50 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80 Sep 23 00:30:50 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:50 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716" returned: 0 in 0.728s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:50 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716 Sep 23 00:30:50 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:50 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80" returned: 0 in 0.490s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.566s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1699171644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8b33e1-170f-4811-a942-dda260b06137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:50Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Creating volume df8b33e1-170f-4811-a942-dda260b06137 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:50 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:50 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137 1073741824 Sep 23 00:30:50 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed432c6b-e428-4b0e-b170-978793cec136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6a5c12-515f-46a9-9130-144689266e80', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2d6497-7df9-478b-a63b-b395579ebe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:50 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (1e70e9a0-52bb-46ee-9721-d24a4da3d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca12b155-ae73-408b-b376-ebfeeef3ea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:51 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume volume-0a6a5c12-515f-46a9-9130-144689266e80 (0a6a5c12-515f-46a9-9130-144689266e80): created successfully Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2d6497-7df9-478b-a63b-b395579ebe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (4eb733df-9e9c-482c-b654-675317573cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-82690399-4a0b-4466-8e7b-2f80f6dde716" returned: 0 in 0.552s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca12b155-ae73-408b-b376-ebfeeef3ea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1690520899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2909320a-2682-4e5a-ad12-f9be62e20afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:51Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7005ab7c-5641-4d4c-995f-51c75be6c678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7005ab7c-5641-4d4c-995f-51c75be6c678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea22881-68c6-49ff-9f3b-4ad6b9bb72e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea22881-68c6-49ff-9f3b-4ad6b9bb72e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2909320a-2682-4e5a-ad12-f9be62e20afb', 'volume_name': 'volume-2909320a-2682-4e5a-ad12-f9be62e20afb', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380abdf5-16d6-4f60-83c3-80cf63b5c2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (380abdf5-16d6-4f60-83c3-80cf63b5c2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63f0410-3a91-4a19-b06f-5ab0684d0217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume 2909320a-2682-4e5a-ad12-f9be62e20afb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2909320a-2682-4e5a-ad12-f9be62e20afb', 'volume_size': 1} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-40c69cf5-4a65-4dc7-bb0a-f47bb497d25d tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created volume successfully. Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-82690399-4a0b-4466-8e7b-2f80f6dde716" released by "delete_volume" :: held 1.517s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdba2a4-a866-46b8-82a8-58f7701a0156]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:51 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c Sep 23 00:30:51 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:51 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137 1073741824" returned: 0 in 0.811s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:51 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137 Sep 23 00:30:51 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (0e64aa15-64ec-40ee-b2f7-416127674602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9198c620-baa7-4ab2-a776-981d14b77953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9198c620-baa7-4ab2-a776-981d14b77953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610806487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:52Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e38a10-a25c-450a-9be1-05c002fd335f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e38a10-a25c-450a-9be1-05c002fd335f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fdf6f9-c1d0-4ce3-981f-9cb0cbf88e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fdf6f9-c1d0-4ce3-981f-9cb0cbf88e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69', 'volume_name': 'volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906bba36-f8df-4020-b3ba-0896275ea331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906bba36-f8df-4020-b3ba-0896275ea331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ebcf59-12c4-44a9-9ca3-09d129d8d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:51 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume 9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69', 'volume_size': 1} Sep 23 00:30:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:52 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" returned: 0 in 0.627s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:52 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c Sep 23 00:30:52 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:52 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137" returned: 0 in 0.486s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1690520899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2909320a-2682-4e5a-ad12-f9be62e20afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:51Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Creating volume 2909320a-2682-4e5a-ad12-f9be62e20afb {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:52 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5861028c-ad28-4247-a9d0-9d184e83fd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8b33e1-170f-4811-a942-dda260b06137', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb88dc5-1ade-4821-9486-1f8f5192fd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:52 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb 1073741824 Sep 23 00:30:52 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:52 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume volume-df8b33e1-170f-4811-a942-dda260b06137 (df8b33e1-170f-4811-a942-dda260b06137): created successfully Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb88dc5-1ade-4821-9486-1f8f5192fd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (4a404359-ca3a-4564-b85c-bbd87b48c22a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:52 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0b49f798-ca62-4aaa-b5b2-97d7c8659513 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created volume successfully. Sep 23 00:30:52 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" returned: 0 in 0.662s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-f64cdbdf-92c9-45eb-a359-f67ab8a1dc0c" released by "delete_volume" :: held 1.411s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (3a880f53-bdf9-4ff2-89fa-70eaec004c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0324591-c9aa-4f97-a90f-a741f153afa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0324591-c9aa-4f97-a90f-a741f153afa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547972293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da48f0d6-4402-497d-bd50-27a5e0ac5797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:53Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c59ef60-b1e3-4ec3-be9b-cc806ebe04e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c59ef60-b1e3-4ec3-be9b-cc806ebe04e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e0faa7-6446-4057-a9ef-16da98a8d950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e0faa7-6446-4057-a9ef-16da98a8d950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da48f0d6-4402-497d-bd50-27a5e0ac5797', 'volume_name': 'volume-da48f0d6-4402-497d-bd50-27a5e0ac5797', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeec840c-e814-4717-807f-eb08ed02ff00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeec840c-e814-4717-807f-eb08ed02ff00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175c62ca-5bab-4b9d-a2cd-b77f554addd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:52 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume da48f0d6-4402-497d-bd50-27a5e0ac5797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da48f0d6-4402-497d-bd50-27a5e0ac5797', 'volume_size': 1} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:52 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (970a2b48-70b6-4621-b071-2d596c339933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0967a32a-9d3b-4ba9-b05f-5d63f6e36ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0967a32a-9d3b-4ba9-b05f-5d63f6e36ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1250088779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db76ca1-6c8f-4c34-aaf3-af73d0187f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:53Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc68e8b-98e4-4203-aec4-9736cacde97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc68e8b-98e4-4203-aec4-9736cacde97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ad3a2f-4bc7-42bb-8969-53866b733609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ad3a2f-4bc7-42bb-8969-53866b733609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db76ca1-6c8f-4c34-aaf3-af73d0187f82', 'volume_name': 'volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:53 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d619871c-d60c-40c0-9cae-bbf076797dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d619871c-d60c-40c0-9cae-bbf076797dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10dd026-d03c-454c-9a26-c60ef245b0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:53 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume 8db76ca1-6c8f-4c34-aaf3-af73d0187f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82', 'volume_size': 1} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['f3549f94-25ee-44b1-86c9-a5f8f7bb9330'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb 1073741824" returned: 0 in 0.866s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:53 devstack cinder-volume[87138]: WARNING cinder.quota [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1185464662 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1185464662, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:53 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb Sep 23 00:30:53 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['11a8a45b-21b0-4a1a-99ab-1786ebce0083', '0afbf582-1264-4fcf-9d9a-18e807ecdbce', 'ac229846-4adf-47c5-82b6-7043b160876f', 'cdb5950b-d51e-46fd-96f5-1f227b36545b', '2f283667-f83b-44d1-b719-ca7289862ef1'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['d7d24043-35c3-4231-aca7-097a034cce2e', '8f794f40-05ea-4fab-a77b-a4087f7df2ae', 'c5ab09e2-4cac-4407-bf68-a2c09f39f096', 'd8bbe764-6763-46d6-9272-db27853e6bbc', 'f8b0e5c0-e571-4c3d-a3e9-9155254429c7'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:53 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb" returned: 0 in 0.365s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610806487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:52Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Creating volume 9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:53 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:53 devstack sudo[103954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 1073741824 Sep 23 00:30:53 devstack sudo[103954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63f0410-3a91-4a19-b06f-5ab0684d0217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2909320a-2682-4e5a-ad12-f9be62e20afb', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4ad9fa-be33-470f-8443-97d70126aec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:53 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:53 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:53 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume volume-2909320a-2682-4e5a-ad12-f9be62e20afb (2909320a-2682-4e5a-ad12-f9be62e20afb): created successfully Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4ad9fa-be33-470f-8443-97d70126aec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (1e70e9a0-52bb-46ee-9721-d24a4da3d56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2e92c898-ae7b-484d-9c88-28da93c44875 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created volume successfully. Sep 23 00:30:53 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.378s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:53 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e8fcf35b-1461-4a4f-b023-3254627dc61e tempest-GroupSnapshotsTest-2125997571 None] Delete group completed successfully. Sep 23 00:30:54 devstack sudo[103954]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 1073741824" returned: 0 in 0.767s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:54 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 Sep 23 00:30:54 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-22b7b252-6c12-4631-91ce-8c57045b0829 tempest-GroupSnapshotsTest-2125997571 None] Group tempest-GroupSnapshotsTest-Group-1007992980: creating Sep 23 00:30:54 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69" returned: 0 in 0.404s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.892s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-547972293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da48f0d6-4402-497d-bd50-27a5e0ac5797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ca48cc6ea54c70a16e8e79e182c651',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:53Z,use_quota=True,user_id='69c184c748114b60953b6de93b530f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Creating volume da48f0d6-4402-497d-bd50-27a5e0ac5797 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:54 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-22b7b252-6c12-4631-91ce-8c57045b0829 tempest-GroupSnapshotsTest-2125997571 None] Group tempest-GroupSnapshotsTest-Group-1007992980: created successfully Sep 23 00:30:54 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 1073741824 Sep 23 00:30:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-22b7b252-6c12-4631-91ce-8c57045b0829 tempest-GroupSnapshotsTest-2125997571 None] Create group completed successfully. Sep 23 00:30:54 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1ebcf59-12c4-44a9-9ca3-09d129d8d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48addb44-aece-47f9-a67b-73885da0f06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:54 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 (9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69): created successfully Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48addb44-aece-47f9-a67b-73885da0f06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (0e64aa15-64ec-40ee-b2f7-416127674602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-69a0c9b5-f01a-4914-ae39-593dc62ea935 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created volume successfully. Sep 23 00:30:55 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 1073741824" returned: 0 in 0.615s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:55 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 Sep 23 00:30:55 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:55 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797" returned: 0 in 0.347s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.708s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1250088779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db76ca1-6c8f-4c34-aaf3-af73d0187f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:53Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Creating volume 8db76ca1-6c8f-4c34-aaf3-af73d0187f82 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:55 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175c62ca-5bab-4b9d-a2cd-b77f554addd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da48f0d6-4402-497d-bd50-27a5e0ac5797', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca88d06-21a1-42b5-b4fa-cb56bd7cc38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:55 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 1073741824 Sep 23 00:30:55 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:55 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Volume volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 (da48f0d6-4402-497d-bd50-27a5e0ac5797): created successfully Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca88d06-21a1-42b5-b4fa-cb56bd7cc38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Flow 'volume_create_manager' (3a880f53-bdf9-4ff2-89fa-70eaec004c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-7549fcb3-6683-483a-a163-5ffce46761a2 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created volume successfully. Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-da48f0d6-4402-497d-bd50-27a5e0ac5797-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-da48f0d6-4402-497d-bd50-27a5e0ac5797-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-quobyte-da48f0d6-4402-497d-bd50-27a5e0ac5797" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-da48f0d6-4402-497d-bd50-27a5e0ac5797" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f414e7ca-b589-4a78-b797-82b6f7c50532]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:56 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 1073741824" returned: 0 in 0.798s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Flow 'volume_create_manager' (15601910-8939-44a0-a72e-81e78dce81cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5f68f9-1d18-4505-8df3-82d853315e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5f68f9-1d18-4505-8df3-82d853315e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132232632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef7dd03f-3335-496f-ac01-879adc97b883,host='devstack@QuobyteHD#QuobyteHD',id=6baa0af3-d4ca-4b65-b53d-f4786e31724b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf2cd49a3d45329dfea301153fcb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:57Z,use_quota=True,user_id='80fd2c4adef042ee887da95bed991608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ba5bb40-5301-41d2-b2fd-035f385f787f),volume_type_id=4ba5bb40-5301-41d2-b2fd-035f385f787f)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:56 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 Sep 23 00:30:56 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d331d53e-1d5c-4193-a423-0e0ce87b0466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d331d53e-1d5c-4193-a423-0e0ce87b0466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30c2b10-b8c3-420c-bc3f-8a2085b45557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30c2b10-b8c3-420c-bc3f-8a2085b45557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6baa0af3-d4ca-4b65-b53d-f4786e31724b', 'volume_name': 'volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87064f9-c66f-4321-8764-524360e00030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87064f9-c66f-4321-8764-524360e00030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fb84ca-71df-4692-8d3a-89a55d094c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:56 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Volume 6baa0af3-d4ca-4b65-b53d-f4786e31724b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b', 'volume_size': 1} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:56 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 Sep 23 00:30:56 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:57 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" returned: 0 in 0.333s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.349s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef7dd03f-3335-496f-ac01-879adc97b883,created_at=2026-09-22T22:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-132232632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef7dd03f-3335-496f-ac01-879adc97b883,host='devstack@QuobyteHD#QuobyteHD',id=6baa0af3-d4ca-4b65-b53d-f4786e31724b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cf2cd49a3d45329dfea301153fcb26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:30:57Z,use_quota=True,user_id='80fd2c4adef042ee887da95bed991608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ba5bb40-5301-41d2-b2fd-035f385f787f),volume_type_id=4ba5bb40-5301-41d2-b2fd-035f385f787f)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Creating volume 6baa0af3-d4ca-4b65-b53d-f4786e31724b {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:30:57 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:57 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10dd026-d03c-454c-9a26-c60ef245b0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae16fe1-0c0c-41fb-876d-922d6d97d272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:57 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b 1073741824 Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797" returned: 0 in 0.648s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:57 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:57 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 (8db76ca1-6c8f-4c34-aaf3-af73d0187f82): created successfully Sep 23 00:30:57 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797 Sep 23 00:30:57 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae16fe1-0c0c-41fb-876d-922d6d97d272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (970a2b48-70b6-4621-b071-2d596c339933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bf6545e1-d88f-4cd6-87ba-e1299e419818 tempest-CreateVolumesFromSnapshotTest-433152752 None] Created volume successfully. Sep 23 00:30:57 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-da48f0d6-4402-497d-bd50-27a5e0ac5797" returned: 0 in 0.416s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-da48f0d6-4402-497d-bd50-27a5e0ac5797" released by "delete_volume" :: held 1.132s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created reservations ['379d9f2e-83c9-4ba3-946a-e18f4c1261ee', 'c4096eb0-6b1a-4313-878e-5d6043fbbd09', 'f7a4379e-8934-4216-8278-d88b2833fb76', 'a9dd293b-6273-438d-adf8-e7fdad82cb03', '6ba2b254-148a-41c9-a6f0-f845463bd6b7'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:30:57 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b 1073741824" returned: 0 in 0.637s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:30:57 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b Sep 23 00:30:57 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:57 devstack sudo[104000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:30:57 devstack sudo[104000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:58 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b" returned: 0 in 0.306s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36fb84ca-71df-4692-8d3a-89a55d094c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d60aff-34ac-494f-a396-55cd8eebd754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:30:58 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Volume volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b (6baa0af3-d4ca-4b65-b53d-f4786e31724b): created successfully Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d60aff-34ac-494f-a396-55cd8eebd754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Flow 'volume_create_manager' (15601910-8939-44a0-a72e-81e78dce81cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:30:58 devstack sudo[104000]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.326s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:30:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Deleted volume successfully. Sep 23 00:30:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-17a37868-7d6c-4dc9-9cae-1b0b0a81dbcd tempest-GroupSnapshotsTest-2125997571 None] Created volume successfully. Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aaf7ab49-5c50-4b04-8dfa-5288af99cedb tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-da48f0d6-4402-497d-bd50-27a5e0ac5797-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Creating offline snapshot bf101e90-6bc2-45e4-b760-00ed44017bd9 of volume 8db76ca1-6c8f-4c34-aaf3-af73d0187f82 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbd7055-bf8d-4601-a44f-e4f25a8dee1f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:58 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 Sep 23 00:30:58 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-quobyte-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69" acquired by "delete_volume" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8772aef3-84c9-4d2d-84fc-c9e557f1ccf4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:30:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:59 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" returned: 0 in 0.513s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:59 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 1G Sep 23 00:30:59 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:59 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 Sep 23 00:30:59 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:59 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69" returned: 0 in 0.497s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:59 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69 Sep 23 00:30:59 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:59 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] GroupSnapshot 03a1ad53-c2a4-4eb0-b7cd-05a4b1e8d227: creating. Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Group snapshot 03a1ad53-c2a4-4eb0-b7cd-05a4b1e8d227: creating. {{(pid=87138) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:30:59 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 1G" returned: 0 in 0.650s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:30:59 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 Sep 23 00:30:59 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:30:59 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69" returned: 0 in 0.469s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:30:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69" released by "delete_volume" :: held 1.046s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created reservations ['ebbf90c1-430a-4574-857f-8c0db6c9c8fa', '0cf1ce13-32f2-4ad7-9aa5-55685f692a77', '1a3291c8-2509-41e0-85b1-137ac2ea3860', 'cf3c4b06-b39b-40e5-81e7-58ddf5b31c0b', '668c2c34-6a81-45e1-8b26-72e8ad46c4fa'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:00 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9" returned: 0 in 0.444s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 is being set with open permissions: ugo+rw Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 Sep 23 00:31:00 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:00 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9" returned: 0 in 0.309s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[104035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.info Sep 23 00:31:00 devstack sudo[104035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:00 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.307s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:00 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Deleted volume successfully. Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0628bbe7-b389-4077-aa59-aba6de1c77f9 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-9ccfb6ef-6b4e-47ba-83e2-6e37bfd7cf69-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:00 devstack sudo[104035]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.info" returned: 0 in 0.367s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:00 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.info is being set with open permissions: ugo+rw Sep 23 00:31:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:00 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.info Sep 23 00:31:00 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-2909320a-2682-4e5a-ad12-f9be62e20afb-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:01 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.info" returned: 0 in 0.299s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.524s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-2909320a-2682-4e5a-ad12-f9be62e20afb-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Creating offline snapshot 7a58501a-400c-4c53-9238-20dfef5db658 of volume 6baa0af3-d4ca-4b65-b53d-f4786e31724b {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:31:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1d0b362b-c4de-43e0-8c46-13de121e216b tempest-CreateVolumesFromSnapshotTest-433152752 None] Create snapshot completed successfully Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0072c946-b811-44b2-80e2-9728761499dd]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-quobyte-2909320a-2682-4e5a-ad12-f9be62e20afb" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-2909320a-2682-4e5a-ad12-f9be62e20afb" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[47353f2a-827e-475f-b0d6-d3a0560b5633]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b Sep 23 00:31:01 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb Sep 23 00:31:01 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b" returned: 0 in 0.461s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 1G Sep 23 00:31:01 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:01 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb" returned: 0 in 0.469s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:01 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb Sep 23 00:31:01 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2909320a-2682-4e5a-ad12-f9be62e20afb" returned: 0 in 0.361s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-2909320a-2682-4e5a-ad12-f9be62e20afb" released by "delete_volume" :: held 0.892s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created reservations ['e66427f3-91ec-4758-a722-3fb30cf5e8d6', '21d79d23-bde6-4fe1-a71d-7aba7330a477', '88f6c9d7-916d-4140-b544-6fdfbd9f2a59', '20e2c957-12ef-4136-99d1-de44395686b1', '7b538431-696a-4166-bb47-5d96e5033d72'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:02 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 1G" returned: 0 in 0.630s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:02 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 Sep 23 00:31:02 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (dd7978c7-6ce4-4eab-9207-a093d2e3368e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b2e677-5ac8-488f-b8f1-f9129cbb77b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b2e677-5ac8-488f-b8f1-f9129cbb77b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-475512977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:02Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211b97f6-f6c0-4605-95f8-0fd6e129a293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211b97f6-f6c0-4605-95f8-0fd6e129a293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0542ae9c-b334-41d9-9dbf-c4c3fcfe51eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0542ae9c-b334-41d9-9dbf-c4c3fcfe51eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6', 'volume_name': 'volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8715a717-4b47-4014-821d-5417ebf4ff6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8715a717-4b47-4014-821d-5417ebf4ff6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370765b5-a57c-43c6-83e2-cbe570b76c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:02 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume 4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6', 'volume_size': 1} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:02 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658" returned: 0 in 0.419s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:02 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:02 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:02 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:02 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (d312c9ab-f172-4837-b39a-f49484f1b274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada922bc-caad-47c8-b4cf-38682a452cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.449s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:02 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:03 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Deleted volume successfully. Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada922bc-caad-47c8-b4cf-38682a452cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910836859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:03Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4277316-ea6d-4915-983d-db4c37b787b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4277316-ea6d-4915-983d-db4c37b787b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f487cb1f-a42b-41c1-840a-a3ce47ea1d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f487cb1f-a42b-41c1-840a-a3ce47ea1d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2', 'volume_name': 'volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ba6398-e809-4597-a7d4-8a7be76f49d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ba6398-e809-4597-a7d4-8a7be76f49d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a77e7a-e562-4a62-b9c1-ccaddf79a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:03 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume 6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2', 'volume_size': 1} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-51532349-ad5b-4ebe-9f5d-b071b40529c0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-2909320a-2682-4e5a-ad12-f9be62e20afb-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:03 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658" returned: 0 in 0.424s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:03 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.info Sep 23 00:31:03 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:03 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.496s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-df8b33e1-170f-4811-a942-dda260b06137-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-df8b33e1-170f-4811-a942-dda260b06137-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-quobyte-df8b33e1-170f-4811-a942-dda260b06137" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-df8b33e1-170f-4811-a942-dda260b06137" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:03 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (747f8209-9664-46a4-9400-1c1192e296ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ad68a5-8876-4665-aeba-d9564cab963e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a286ab9-daf8-4f45-882c-bcb99a1f841d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.info" returned: 0 in 0.549s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:03 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ad68a5-8876-4665-aeba-d9564cab963e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-83319185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc3b3dd-c14f-4e96-a0e2-65d631d7636f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:04Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0192ec69-124b-4c2a-996d-dd06afc6cb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0192ec69-124b-4c2a-996d-dd06afc6cb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:03 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.info Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577d4760-8ee5-4d05-b36a-7634e47acf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:03 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577d4760-8ee5-4d05-b36a-7634e47acf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc3b3dd-c14f-4e96-a0e2-65d631d7636f', 'volume_name': 'volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22497719-e647-4123-8cbf-df7c225d7bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22497719-e647-4123-8cbf-df7c225d7bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5705ea5f-fba7-45a0-8b2e-05737eb8b1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:03 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume bbc3b3dd-c14f-4e96-a0e2-65d631d7636f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f', 'volume_size': 1} Sep 23 00:31:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:03 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137 Sep 23 00:31:03 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.info" returned: 0 in 0.398s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.040s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.727s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-475512977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:02Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Creating volume 4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:04 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:04 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 1073741824 Sep 23 00:31:04 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137" returned: 0 in 0.627s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (361da1ff-ef00-46b2-ac03-d798d110cad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:04 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137 Sep 23 00:31:04 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfb0829-9942-4181-b7b7-84077bb28697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfb0829-9942-4181-b7b7-84077bb28697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14429751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d69aa1-7119-4e60-8732-e9c8176398aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:04Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0364a1c4-d326-439e-ad3d-75d94b0091d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0364a1c4-d326-439e-ad3d-75d94b0091d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b38d65-89ca-440f-885c-b47eac3285da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80b38d65-89ca-440f-885c-b47eac3285da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d69aa1-7119-4e60-8732-e9c8176398aa', 'volume_name': 'volume-09d69aa1-7119-4e60-8732-e9c8176398aa', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581dacf8-b145-4a25-9487-cbea8fe387cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581dacf8-b145-4a25-9487-cbea8fe387cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5514eeee-efe8-437a-b085-0cf313db4898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume 09d69aa1-7119-4e60-8732-e9c8176398aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d69aa1-7119-4e60-8732-e9c8176398aa', 'volume_size': 1} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:04 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b6df87a4-70ca-4015-8900-0d90239579fa tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 03a1ad53-c2a4-4eb0-b7cd-05a4b1e8d227: created successfully Sep 23 00:31:04 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-df8b33e1-170f-4811-a942-dda260b06137" returned: 0 in 0.420s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-df8b33e1-170f-4811-a942-dda260b06137" released by "delete_volume" :: held 1.176s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (c9830b64-c8ab-4969-a7e5-63943dd789cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22d364e-37b6-48b8-9097-d7c6be0cf234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22d364e-37b6-48b8-9097-d7c6be0cf234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728371029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56df1b9a-d20e-41fc-9947-8a5b379ff1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:05Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff9d503-9f27-4ee5-94d3-982d1494a190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff9d503-9f27-4ee5-94d3-982d1494a190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04a5f1d-60e2-4c47-98d4-49d5a002faa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04a5f1d-60e2-4c47-98d4-49d5a002faa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56df1b9a-d20e-41fc-9947-8a5b379ff1de', 'volume_name': 'volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d015ca-50e5-47fa-a7c2-4704f773a87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d015ca-50e5-47fa-a7c2-4704f773a87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e2fe92-9ae2-4e61-9d2a-000505343499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:04 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume 56df1b9a-d20e-41fc-9947-8a5b379ff1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de', 'volume_size': 1} Sep 23 00:31:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created reservations ['a51d1e84-691b-4706-9dd1-3c111a9a1f7b', 'af20aece-ad4a-4fd2-abed-1a06bbc4282b', '8f595c30-e885-431d-82e0-8c585c9d3db7', '83581870-0d04-4999-8716-fe6133c58224', '64279e9c-573a-45f3-8c20-7d49dc7b4db5'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:05 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 1073741824" returned: 0 in 0.735s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:05 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 Sep 23 00:31:05 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:05 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:05 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:05 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 03a1ad53-c2a4-4eb0-b7cd-05a4b1e8d227: deleting Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 03a1ad53-c2a4-4eb0-b7cd-05a4b1e8d227: deleting {{(pid=87138) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-6baa0af3-d4ca-4b65-b53d-f4786e31724b" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-6baa0af3-d4ca-4b65-b53d-f4786e31724b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-7a58501a-400c-4c53-9238-20dfef5db658" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-7a58501a-400c-4c53-9238-20dfef5db658" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Deleting offline snapshot 7a58501a-400c-4c53-9238-20dfef5db658 of volume 6baa0af3-d4ca-4b65-b53d-f4786e31724b {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] snapshot_file for this snap is: volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:31:05 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6" returned: 0 in 0.330s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.385s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-910836859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:03Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Creating volume 6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:05 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c149d7b-e059-4738-83a7-0e44c72c8957]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:05 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 1073741824 Sep 23 00:31:05 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370765b5-a57c-43c6-83e2-cbe570b76c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310338dc-8b13-4218-9c04-e0f4cc496830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:05 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 (4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6): created successfully Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (310338dc-8b13-4218-9c04-e0f4cc496830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (dd7978c7-6ce4-4eab-9207-a093d2e3368e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:05 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9700a352-91df-4197-8748-b9ccbee6af22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Created volume successfully. Sep 23 00:31:05 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.421s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:05 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Deleted volume successfully. Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3a6f95c5-eb0b-46d8-a130-395e6fd92fc1 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-df8b33e1-170f-4811-a942-dda260b06137-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:05 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 Sep 23 00:31:05 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-0a6a5c12-515f-46a9-9130-144689266e80-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-0a6a5c12-515f-46a9-9130-144689266e80-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-quobyte-0a6a5c12-515f-46a9-9130-144689266e80" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-0a6a5c12-515f-46a9-9130-144689266e80" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd3979-102c-4c9c-8756-15203d9581c7]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658" returned: 0 in 0.645s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:31:06 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80 Sep 23 00:31:06 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad544d8-e76b-4893-8644-e19890e24ff6]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 1073741824" returned: 0 in 0.752s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 Sep 23 00:31:06 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:06 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b Sep 23 00:31:06 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:06 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80" returned: 0 in 0.532s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80 Sep 23 00:31:06 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:06 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2" returned: 0 in 0.365s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.789s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-83319185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc3b3dd-c14f-4e96-a0e2-65d631d7636f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:04Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Creating volume bbc3b3dd-c14f-4e96-a0e2-65d631d7636f {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:06 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1a77e7a-e562-4a62-b9c1-ccaddf79a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:06 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f 1073741824 Sep 23 00:31:06 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ded9d3d-bde4-4879-a1ac-05c755d98f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b" returned: 0 in 0.506s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:06 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 (6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2): created successfully Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ded9d3d-bde4-4879-a1ac-05c755d98f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (d312c9ab-f172-4837-b39a-f49484f1b274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:06 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 Sep 23 00:31:06 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-93d1a950-a735-4c16-b537-3758e7dd13e9 tempest-CreateVolumesFromSnapshotTest-433152752 None] Created volume successfully. Sep 23 00:31:06 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0a6a5c12-515f-46a9-9130-144689266e80" returned: 0 in 0.397s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-0a6a5c12-515f-46a9-9130-144689266e80" released by "delete_volume" :: held 1.005s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created reservations ['30e67cb4-8e0b-4178-abec-3d7f49e52d98', '2c026258-c6ae-4555-90ac-51d912605c98', 'c9f934a4-d3c5-4c9d-99ca-2ddb91611b97', '25f1debd-b8a6-4add-b0c4-82e7bd9d992f', 'c0ebf72a-8721-43ac-8c39-6ca30fb84ae6'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:07 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:07 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:07 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658" returned: 0 in 0.550s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:07 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658 Sep 23 00:31:07 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:07 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f 1073741824" returned: 0 in 0.709s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:07 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f Sep 23 00:31:07 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:07 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.364s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:07 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b.7a58501a-400c-4c53-9238-20dfef5db658" returned: 0 in 0.313s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:07 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Deleted volume successfully. Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-7a58501a-400c-4c53-9238-20dfef5db658" released by "_delete_snapshot" :: held 2.240s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-6baa0af3-d4ca-4b65-b53d-f4786e31724b" released by "delete_snapshot" :: held 2.283s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e7c132c6-b919-437b-975b-068fdc0c35d0 tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-0a6a5c12-515f-46a9-9130-144689266e80-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:07 devstack cinder-volume[87138]: WARNING cinder.quota [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1242359352 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1242359352, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:07 devstack cinder-volume[87138]: WARNING cinder.quota [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1242359352 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1242359352, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:07 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f" returned: 0 in 0.342s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.270s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14429751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d69aa1-7119-4e60-8732-e9c8176398aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:04Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Creating volume 09d69aa1-7119-4e60-8732-e9c8176398aa {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:07 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5705ea5f-fba7-45a0-8b2e-05737eb8b1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:07 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa 1073741824 Sep 23 00:31:07 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bd2c66-6822-4992-ac29-53372f06fd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['bf43fa56-2abd-44cf-846d-f4089632af98', '77705432-1ec6-4862-b463-76bdda4e446d', '0ec9780c-df51-47c5-8fd4-5656a9c1c825', 'a6cd4b70-b68b-437c-b973-bc37f80b43e5', 'c8ccbb3a-d29f-42f4-b341-fab6bdbbceab'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:07 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f (bbc3b3dd-c14f-4e96-a0e2-65d631d7636f): created successfully Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60bd2c66-6822-4992-ac29-53372f06fd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (747f8209-9664-46a4-9400-1c1192e296ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:07 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-82d1eae0-3dd6-46e1-9067-78c0dba74a4f tempest-CreateVolumesFromSnapshotTest-433152752 None] Created volume successfully. Sep 23 00:31:07 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4c0e3ca1-9ad7-4010-aca6-867f1c2d9dfe tempest-GroupSnapshotsTest-2125997571 None] group_snapshot 03a1ad53-c2a4-4eb0-b7cd-05a4b1e8d227: deleted successfully Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-688bf7d9-e62d-466e-b66b-eff95c230900-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-688bf7d9-e62d-466e-b66b-eff95c230900-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "cinder-quobyte-688bf7d9-e62d-466e-b66b-eff95c230900" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-688bf7d9-e62d-466e-b66b-eff95c230900" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9e5d7b-8099-4abd-a78e-4b69d1ba454f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:08 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa 1073741824" returned: 0 in 0.625s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:08 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900 Sep 23 00:31:08 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:08 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa Sep 23 00:31:08 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:08 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa" returned: 0 in 0.350s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.844s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1728371029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56df1b9a-d20e-41fc-9947-8a5b379ff1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd51ca546e6a40f0abbc405cda19f525',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:05Z,use_quota=True,user_id='45e780177a42415a8bbeeb721067320e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Creating volume 56df1b9a-d20e-41fc-9947-8a5b379ff1de {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:08 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:08 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900" returned: 0 in 0.527s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:08 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de 1073741824 Sep 23 00:31:08 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5514eeee-efe8-437a-b085-0cf313db4898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d69aa1-7119-4e60-8732-e9c8176398aa', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167b4186-7b99-4024-9198-83f56be7ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:08 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900 Sep 23 00:31:08 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:08 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume volume-09d69aa1-7119-4e60-8732-e9c8176398aa (09d69aa1-7119-4e60-8732-e9c8176398aa): created successfully Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (167b4186-7b99-4024-9198-83f56be7ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (361da1ff-ef00-46b2-ac03-d798d110cad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-da485c21-f252-48ea-82ec-c83db2ef4043 tempest-CreateVolumesFromSnapshotTest-433152752 None] Created volume successfully. Sep 23 00:31:09 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-688bf7d9-e62d-466e-b66b-eff95c230900" returned: 0 in 0.329s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-quobyte-688bf7d9-e62d-466e-b66b-eff95c230900" released by "delete_volume" :: held 0.911s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "cinder-quobyte-6baa0af3-d4ca-4b65-b53d-f4786e31724b" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-6baa0af3-d4ca-4b65-b53d-f4786e31724b" acquired by "delete_volume" :: waited 0.026s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8184a4b9-beb7-404a-8911-882193b396c1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Created reservations ['18bfc5f4-2c45-41ae-9244-2141e021a001', '9af7189f-8eee-45f0-92a0-03436a1fd528', '68c5d2de-dfd0-489b-b250-c5cd524e8350', '00274a89-a367-4b08-800d-19a6ae302ddb', 'd62ca290-8aa5-42c0-8afe-2cc8efe56e0b'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:09 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de 1073741824" returned: 0 in 0.674s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:09 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:09 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:09 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:09 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:09 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de Sep 23 00:31:09 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:09 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:09 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b" returned: 0 in 0.526s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Deleted volume successfully. Sep 23 00:31:09 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:09 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b Sep 23 00:31:09 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e6340801-342b-419d-9799-7ac8efd5295e tempest-CreateVolumesFromSourceVolumeTest-97390997 None] Lock "cinder-688bf7d9-e62d-466e-b66b-eff95c230900-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de" returned: 0 in 0.340s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e2fe92-9ae2-4e61-9d2a-000505343499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206b73f4-9696-43d9-bdba-2a5a4380d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:09 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Volume volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de (56df1b9a-d20e-41fc-9947-8a5b379ff1de): created successfully Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (206b73f4-9696-43d9-bdba-2a5a4380d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Flow 'volume_create_manager' (c9830b64-c8ab-4969-a7e5-63943dd789cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2411840e-f3cd-45bd-a3a8-29db409a8b22 tempest-CreateVolumesFromSnapshotTest-433152752 None] Created volume successfully. Sep 23 00:31:10 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6baa0af3-d4ca-4b65-b53d-f4786e31724b" returned: 0 in 0.318s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Lock "cinder-quobyte-6baa0af3-d4ca-4b65-b53d-f4786e31724b" released by "delete_volume" :: held 0.959s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['f2e5877a-a47e-46ca-a105-c396fb81f5d9'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:10 devstack cinder-volume[87138]: WARNING cinder.quota [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1242359352 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1242359352, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Created reservations ['cb2675aa-66c2-41f4-9b1e-0bb8f7b3802c', '929a8cb1-9c0f-4bfe-a3fe-5df7958f7ff4', '1b9d04b3-cef8-423b-90bf-e7a4ea97b98a', '274e029f-13af-47d5-9915-db1a0d426a17', '6271dafa-75f6-49cb-8d49-d557582cc3c3'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:10 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:10 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-56df1b9a-d20e-41fc-9947-8a5b379ff1de-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-56df1b9a-d20e-41fc-9947-8a5b379ff1de-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-quobyte-56df1b9a-d20e-41fc-9947-8a5b379ff1de" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-56df1b9a-d20e-41fc-9947-8a5b379ff1de" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5d2ef3-1e71-4654-ba27-950c3f5142d2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:10 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.384s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:10 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-72620d6b-6e30-419b-a24a-cd78815e5a89 tempest-GroupSnapshotsTest-2125997571 None] Delete group completed successfully. Sep 23 00:31:10 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de Sep 23 00:31:10 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:11 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de" returned: 0 in 0.510s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:11 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de Sep 23 00:31:11 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:11 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56df1b9a-d20e-41fc-9947-8a5b379ff1de" returned: 0 in 0.375s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:11 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-56df1b9a-d20e-41fc-9947-8a5b379ff1de" released by "delete_volume" :: held 0.956s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:11 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Created reservations ['01fcea77-efd3-42c0-94a5-21f1e7e7e5f8', '5df643d7-f00c-4a91-afcb-bf98bc3f9e24', '6980b19c-dbfb-43cd-9d64-6b1ef048fe90', '34b5be23-9f78-4204-b76d-5caf355bc957', '92e65d08-dc14-4924-aad8-880ba236a3ae'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:12 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:12 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:12 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.334s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:12 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:12 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Deleted volume successfully. Sep 23 00:31:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-7b2c2cab-f0ff-4ed3-9cea-b4b4f2cb1b42 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-56df1b9a-d20e-41fc-9947-8a5b379ff1de-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-09d69aa1-7119-4e60-8732-e9c8176398aa-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-09d69aa1-7119-4e60-8732-e9c8176398aa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-quobyte-09d69aa1-7119-4e60-8732-e9c8176398aa" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-09d69aa1-7119-4e60-8732-e9c8176398aa" acquired by "delete_volume" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:13 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef1bd8-85cd-4868-81aa-efe96c3c2b5a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:13 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa Sep 23 00:31:13 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:13 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa" returned: 0 in 0.503s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:13 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa Sep 23 00:31:13 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:14 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-09d69aa1-7119-4e60-8732-e9c8176398aa" returned: 0 in 0.370s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-09d69aa1-7119-4e60-8732-e9c8176398aa" released by "delete_volume" :: held 0.946s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Created reservations ['094beca9-cd51-4794-beed-32b0f8d298be', 'ef6350a4-c16c-48a1-badb-19dd18f10585', '0f55e435-9ccc-4ce5-a593-f428d560a647', '29ba2d1a-1415-4992-8b58-7a2e235b6db0', '212740c3-784d-4881-bb95-776a4879e1ed'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:14 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:14 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:14 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.342s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:14 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Deleted volume successfully. Sep 23 00:31:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-cc8a81fa-9d97-4f94-aa35-d0b20ddc8a74 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-09d69aa1-7119-4e60-8732-e9c8176398aa-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-quobyte-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:15 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd37a4ae-e99f-49e2-a35e-b4ab3cfb57b7]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:15 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f Sep 23 00:31:15 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f" returned: 0 in 0.578s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f Sep 23 00:31:16 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Flow 'volume_create_manager' (626b3ba9-8aee-4354-af8d-9d09aaef566c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765cde18-0047-4571-8d71-e9bfee6bbcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (765cde18-0047-4571-8d71-e9bfee6bbcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734583657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f88e47-a1a5-4f3f-8e6e-a26c9d447c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b429ebe0b94c4c2a8b67497040446572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:16Z,use_quota=True,user_id='7ccb7fde58b040ec814ed7c5bfe8ee6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50994555-df69-4423-8626-e3149f724992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50994555-df69-4423-8626-e3149f724992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afefde1-9c74-4e11-958a-e42739a36204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2afefde1-9c74-4e11-958a-e42739a36204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f88e47-a1a5-4f3f-8e6e-a26c9d447c98', 'volume_name': 'volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dffe208-a571-49da-a5cf-3903a7b6294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dffe208-a571-49da-a5cf-3903a7b6294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ddee10-4f55-47ed-a26f-f75855d874c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:16 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Volume 26f88e47-a1a5-4f3f-8e6e-a26c9d447c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98', 'volume_size': 1} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-734583657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f88e47-a1a5-4f3f-8e6e-a26c9d447c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b429ebe0b94c4c2a8b67497040446572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:16Z,use_quota=True,user_id='7ccb7fde58b040ec814ed7c5bfe8ee6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Creating volume 26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:16 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 1073741824 Sep 23 00:31:16 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:16 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f" returned: 0 in 0.315s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f" released by "delete_volume" :: held 0.979s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Created reservations ['4677991b-c802-49b4-9f9d-8b4a54df09ef', '8bd58fef-35cb-468d-92ce-35bfe1d6f662', '1393820c-c699-4153-9e22-6f52c1ceaf0e', '83dde410-56ff-45d2-82d1-06a3694a99a7', '819fd1ed-d80b-42d7-a2bf-5e8a49def245'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:16 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:16 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:17 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 1073741824" returned: 0 in 0.609s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:17 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 Sep 23 00:31:17 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:17 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.396s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Deleted volume successfully. Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2760acf9-35e6-40e4-81fd-ac6832183eec tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-bbc3b3dd-c14f-4e96-a0e2-65d631d7636f-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:17 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98" returned: 0 in 0.296s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ddee10-4f55-47ed-a26f-f75855d874c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d398eb-0965-4f05-a6b8-b228fe6975f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:17 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Volume volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 (26f88e47-a1a5-4f3f-8e6e-a26c9d447c98): created successfully Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52d398eb-0965-4f05-a6b8-b228fe6975f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Flow 'volume_create_manager' (626b3ba9-8aee-4354-af8d-9d09aaef566c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-02f71cc4-e3df-4320-887b-2ac9d9be5772 tempest-ProjectReaderTests-825509704 None] Created volume successfully. Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-quobyte-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd387a5-f054-4665-a154-714bb9da43aa]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 Sep 23 00:31:18 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2" returned: 0 in 0.546s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2 Sep 23 00:31:18 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Acquiring lock "cinder-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Lock "cinder-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:18 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Acquiring lock "cinder-quobyte-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2" returned: 0 in 0.370s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2" released by "delete_volume" :: held 1.014s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Lock "cinder-quobyte-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98" acquired by "delete_volume" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab8efbe-5d73-4a41-a7e8-effd7bf676fe]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:18 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Created reservations ['ea562026-6885-4cb2-84bb-67c5d2903c8b', 'eff41321-a0a1-42fb-bf78-8af8de225e08', '576c34db-e956-4482-b69e-d2005224da49', '4683b77a-41b6-408e-a23a-81092ea89d24', 'f6513ecb-92a2-4020-b860-e81f762287a1'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:19 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 Sep 23 00:31:19 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:19 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:19 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.295s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:19 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98" returned: 0 in 0.479s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Deleted volume successfully. Sep 23 00:31:19 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98 Sep 23 00:31:19 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83fb0613-4029-44c9-96e4-d6963618cbef tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-6521bdc1-ad90-41ec-89b2-e25b3fc7d3b2-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:19 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98" returned: 0 in 0.322s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Lock "cinder-quobyte-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98" released by "delete_volume" :: held 0.875s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Created reservations ['f87371be-ebb6-4c52-8ffd-859f286401bd', '15ea3f01-eb18-4192-9b6f-e7eb90e691ba', 'd7aa9513-df10-45a8-b978-99129ddb5336', '8c940e45-ab1d-4993-9716-172e175dd671', '6b4cabef-a4a9-478b-b328-9f3948f8c110'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:19 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:19 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=256,cinder:INSERT=75,cinder:UPDATE=295,cinder:DELETE=20 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4885dcdd-ebc4-44c6-80d8-e0f2bfca7db8 tempest-GroupSnapshotsV319Test-324303415 None] Group tempest-GroupSnapshotsV319Test-Group-1014320965: creating Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=317,cinder:SELECT=221,cinder:INSERT=88,cinder:DELETE=20 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:31:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4885dcdd-ebc4-44c6-80d8-e0f2bfca7db8 tempest-GroupSnapshotsV319Test-324303415 None] Group tempest-GroupSnapshotsV319Test-Group-1014320965: created successfully Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4885dcdd-ebc4-44c6-80d8-e0f2bfca7db8 tempest-GroupSnapshotsV319Test-324303415 None] Create group completed successfully. Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-quobyte-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4793ca28-0078-46d7-ab2c-1d06f58c2602]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.434s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Deleted volume successfully. Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-537f8dcd-084c-4ccd-a0af-47316779a116 tempest-ProjectReaderTests-825509704 None] Lock "cinder-26f88e47-a1a5-4f3f-8e6e-a26c9d447c98-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:20 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 Sep 23 00:31:20 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Flow 'volume_create_manager' (94fb7dc5-a7de-4735-96c5-978392074187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3931b186-6261-4c4e-a38d-89a3b1affad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3931b186-6261-4c4e-a38d-89a3b1affad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498078042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c7b7c5-d623-458a-9b0e-e07b570d7415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b429ebe0b94c4c2a8b67497040446572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:21Z,use_quota=True,user_id='7ccb7fde58b040ec814ed7c5bfe8ee6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6eba17a-a331-4f11-a72f-2a8c4dccdb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6eba17a-a331-4f11-a72f-2a8c4dccdb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c87297-29a8-4c77-88e2-08404786089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c87297-29a8-4c77-88e2-08404786089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0c7b7c5-d623-458a-9b0e-e07b570d7415', 'volume_name': 'volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83273b17-431c-4a82-9073-89906d734c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83273b17-431c-4a82-9073-89906d734c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa160e53-69cd-4803-a06d-5a85c1f1c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:20 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Volume f0c7b7c5-d623-458a-9b0e-e07b570d7415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415', 'volume_size': 1} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1498078042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c7b7c5-d623-458a-9b0e-e07b570d7415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b429ebe0b94c4c2a8b67497040446572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:21Z,use_quota=True,user_id='7ccb7fde58b040ec814ed7c5bfe8ee6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Creating volume f0c7b7c5-d623-458a-9b0e-e07b570d7415 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:20 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6" returned: 0 in 0.596s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:20 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 1073741824 Sep 23 00:31:20 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:20 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6 Sep 23 00:31:20 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:21 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6" returned: 0 in 0.415s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6" released by "delete_volume" :: held 1.086s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Created reservations ['229adb6b-bbb9-4320-9ca5-72beea17d2df', '3b09da6e-65de-4acb-9fb6-290561fb55b1', '76062edf-d3d7-4fa4-b8fa-19cd4412a4ae', '2308e0d4-eb2b-4cbf-abaf-48b8fe6053e8', 'c97f9b61-eaf6-4677-a928-f377cefbc30a'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:21 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:21 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 1073741824" returned: 0 in 0.779s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:21 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:21 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 Sep 23 00:31:21 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:21 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.342s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:21 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:21 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Deleted volume successfully. Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a2b59ebf-aef1-469e-b6b5-8a0d61f82d29 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-4e6b4f55-09e3-4e10-8946-2b5bf4ac68c6-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:22 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415" returned: 0 in 0.403s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa160e53-69cd-4803-a06d-5a85c1f1c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54101b0-4756-434f-a013-066f6f3be9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:22 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Volume volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 (f0c7b7c5-d623-458a-9b0e-e07b570d7415): created successfully Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54101b0-4756-434f-a013-066f6f3be9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Flow 'volume_create_manager' (94fb7dc5-a7de-4735-96c5-978392074187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Flow 'volume_create_manager' (8e317d42-d7cb-4bbe-8d47-cc5be906ad84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ec7591-1227-45e9-970d-660096c7a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f4a94fa0-90b6-4268-ab49-5511fe567e5a tempest-ProjectReaderTests-825509704 None] Created volume successfully. Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ec7591-1227-45e9-970d-660096c7a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621829402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57e06201-cf82-43ec-8eab-df63949fed50,host='devstack@QuobyteHD#QuobyteHD',id=030b6ff1-19d4-4f63-b93e-16dbbd897567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6858eb45faf4d0499aab102723d6a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:22Z,use_quota=True,user_id='8ef8a72192994d1c9afb7a7edc6c1152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12c43835-73e9-48df-ab41-f81a708d9cd5),volume_type_id=12c43835-73e9-48df-ab41-f81a708d9cd5)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b782f5-4208-4549-82c4-b6f305fdb3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b782f5-4208-4549-82c4-b6f305fdb3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca41ddb1-42bd-4c85-a29f-e9fb6dc739c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca41ddb1-42bd-4c85-a29f-e9fb6dc739c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030b6ff1-19d4-4f63-b93e-16dbbd897567', 'volume_name': 'volume-030b6ff1-19d4-4f63-b93e-16dbbd897567', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee215d9-5731-4257-913f-decc5c64484e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee215d9-5731-4257-913f-decc5c64484e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26bced0-96c8-490a-b0ac-5c792aa0db5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:22 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Volume 030b6ff1-19d4-4f63-b93e-16dbbd897567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030b6ff1-19d4-4f63-b93e-16dbbd897567', 'volume_size': 1} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57e06201-cf82-43ec-8eab-df63949fed50,created_at=2026-09-22T22:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1621829402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57e06201-cf82-43ec-8eab-df63949fed50,host='devstack@QuobyteHD#QuobyteHD',id=030b6ff1-19d4-4f63-b93e-16dbbd897567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6858eb45faf4d0499aab102723d6a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:22Z,use_quota=True,user_id='8ef8a72192994d1c9afb7a7edc6c1152',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12c43835-73e9-48df-ab41-f81a708d9cd5),volume_type_id=12c43835-73e9-48df-ab41-f81a708d9cd5)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Creating volume 030b6ff1-19d4-4f63-b93e-16dbbd897567 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:22 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 1073741824 Sep 23 00:31:22 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-bf101e90-6bc2-45e4-b760-00ed44017bd9-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-bf101e90-6bc2-45e4-b760-00ed44017bd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-quobyte-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-quobyte-bf101e90-6bc2-45e4-b760-00ed44017bd9" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-bf101e90-6bc2-45e4-b760-00ed44017bd9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Deleting offline snapshot bf101e90-6bc2-45e4-b760-00ed44017bd9 of volume 8db76ca1-6c8f-4c34-aaf3-af73d0187f82 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] snapshot_file for this snap is: volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1801012-0594-4448-8470-45a5f278b2c4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:22 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 Sep 23 00:31:22 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Acquiring lock "cinder-f0c7b7c5-d623-458a-9b0e-e07b570d7415-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Lock "cinder-f0c7b7c5-d623-458a-9b0e-e07b570d7415-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Acquiring lock "cinder-quobyte-f0c7b7c5-d623-458a-9b0e-e07b570d7415" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Lock "cinder-quobyte-f0c7b7c5-d623-458a-9b0e-e07b570d7415" acquired by "delete_volume" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:23 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 1073741824" returned: 0 in 0.791s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ed8a06-b306-4994-8125-b80c42670591]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:23 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 Sep 23 00:31:23 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9" returned: 0 in 0.680s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:31:23 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 Sep 23 00:31:23 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b528f3-d996-454b-b962-e45eed3a8008]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:23 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 Sep 23 00:31:23 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567" returned: 0 in 0.363s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26bced0-96c8-490a-b0ac-5c792aa0db5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030b6ff1-19d4-4f63-b93e-16dbbd897567', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed181bdb-9655-4402-8dde-231f3a313621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Volume volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 (030b6ff1-19d4-4f63-b93e-16dbbd897567): created successfully Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed181bdb-9655-4402-8dde-231f3a313621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Flow 'volume_create_manager' (8e317d42-d7cb-4bbe-8d47-cc5be906ad84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:23 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-eb51c0f8-37f4-4010-ba87-8da59ed30ce6 tempest-GroupSnapshotsV319Test-324303415 None] Created volume successfully. Sep 23 00:31:23 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415" returned: 0 in 0.555s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:23 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415 Sep 23 00:31:23 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:23 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" returned: 0 in 0.531s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:23 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 Sep 23 00:31:23 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:24 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f0c7b7c5-d623-458a-9b0e-e07b570d7415" returned: 0 in 0.373s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Lock "cinder-quobyte-f0c7b7c5-d623-458a-9b0e-e07b570d7415" released by "delete_volume" :: held 0.995s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Created reservations ['61dd1733-0232-4bdc-b9cf-204f190c65d5', '28b2e0e3-823d-4b75-8a49-d6175a31df3f', '08051fc8-d156-4d46-839f-1f6143138a84', 'df1ecc0c-048e-4f50-a04a-b26220d05fb8', 'af42d228-372e-467a-bb95-fff5287cdd2d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:24 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:24 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:24 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9" returned: 0 in 0.502s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:24 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9 Sep 23 00:31:24 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:24 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.348s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Deleted volume successfully. Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d70c1582-248a-438f-8f56-80459a10a6ac tempest-ProjectReaderTests-825509704 None] Lock "cinder-f0c7b7c5-d623-458a-9b0e-e07b570d7415-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:24 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82.bf101e90-6bc2-45e4-b760-00ed44017bd9" returned: 0 in 0.416s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-bf101e90-6bc2-45e4-b760-00ed44017bd9" released by "_delete_snapshot" :: held 2.307s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" released by "delete_snapshot" :: held 2.341s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:24 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Created reservations ['af779a80-77c3-4fa6-9978-c48e7689abbf', 'edaba02b-288c-4ee8-861f-04e3de66ce30', '3697cc4f-ad37-42d0-8475-3942362c517c', 'b3344069-57d5-4ed0-a79d-0630185fb0e6', 'cbf99700-a046-4425-a893-084658d83807'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Delete snapshot completed successfully. Sep 23 00:31:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4718ee01-f57b-4092-b443-616ef6bd0e58 tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-bf101e90-6bc2-45e4-b760-00ed44017bd9-delete_snapshot" released by "delete_snapshot" :: held 2.577s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-8db76ca1-6c8f-4c34-aaf3-af73d0187f82-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-8db76ca1-6c8f-4c34-aaf3-af73d0187f82-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "cinder-quobyte-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:25 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2408b7-ba87-4a22-8b5d-5e072e10bf00]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] GroupSnapshot 23b88dfd-8d7e-4adf-8a34-4970a1883360: creating. Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Group snapshot 23b88dfd-8d7e-4adf-8a34-4970a1883360: creating. {{(pid=87138) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:26 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 Sep 23 00:31:26 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Creating offline snapshot d0c0a9bb-1240-4b00-85d5-59c7f18747f9 of volume 030b6ff1-19d4-4f63-b93e-16dbbd897567 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd30b4a-705d-4477-a583-fa605c2e25c1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:26 devstack sudo[104328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 Sep 23 00:31:26 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:26 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" returned: 0 in 0.490s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:26 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82 Sep 23 00:31:26 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:26 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567" returned: 0 in 0.637s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:26 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 1G Sep 23 00:31:26 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:26 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" returned: 0 in 0.434s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-quobyte-8db76ca1-6c8f-4c34-aaf3-af73d0187f82" released by "delete_volume" :: held 1.039s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Created reservations ['179f2eeb-2662-4a78-b0cc-0a21c3df586d', 'cc152b98-bcb9-4480-b1d5-b84c249e93a4', '47cddc55-db08-4bab-b044-32133f4259f6', '46ef75ed-1a06-4531-8266-139d42219d97', 'cac167ef-3dea-44f6-aeca-c4d0b8d9f187'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:27 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:27 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:27 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 1G" returned: 0 in 0.671s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:27 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 Sep 23 00:31:27 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:27 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.371s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:27 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Deleted volume successfully. Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c611db5c-6ca1-4337-92ae-e92de22f74cd tempest-CreateVolumesFromSnapshotTest-433152752 None] Lock "cinder-8db76ca1-6c8f-4c34-aaf3-af73d0187f82-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:27 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9" returned: 0 in 0.446s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:27 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:31:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:27 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 Sep 23 00:31:27 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:28 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9" returned: 0 in 0.368s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:28 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.info Sep 23 00:31:28 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:28 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.info" returned: 0 in 0.337s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:28 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.info is being set with open permissions: ugo+rw: NotImplementedError Sep 23 00:31:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:28 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.info Sep 23 00:31:28 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:29 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.info" returned: 0 in 0.322s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.921s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2685f18c-8c9c-4e56-b6b3-f7e9ab628b35 tempest-GroupSnapshotsV319Test-324303415 None] group_snapshot 23b88dfd-8d7e-4adf-8a34-4970a1883360: created successfully Sep 23 00:31:30 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] group_snapshot 23b88dfd-8d7e-4adf-8a34-4970a1883360: deleting Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] group_snapshot 23b88dfd-8d7e-4adf-8a34-4970a1883360: deleting {{(pid=87138) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Acquiring lock "cinder-quobyte-030b6ff1-19d4-4f63-b93e-16dbbd897567" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Lock "cinder-quobyte-030b6ff1-19d4-4f63-b93e-16dbbd897567" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Acquiring lock "cinder-quobyte-d0c0a9bb-1240-4b00-85d5-59c7f18747f9" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Lock "cinder-quobyte-d0c0a9bb-1240-4b00-85d5-59c7f18747f9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Deleting offline snapshot d0c0a9bb-1240-4b00-85d5-59c7f18747f9 of volume 030b6ff1-19d4-4f63-b93e-16dbbd897567 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] snapshot_file for this snap is: volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6707ca-8f0a-4ef7-b8eb-3dda1a827e0c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:30 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 Sep 23 00:31:30 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:30 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9" returned: 0 in 0.641s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-030b6ff1-19d4-4f63-b93e-16dbbd897567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b89bd53-a2c5-471b-9b9c-dd840d4010b8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:31 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 Sep 23 00:31:31 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:31 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567" returned: 0 in 0.548s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:31 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 Sep 23 00:31:31 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:32 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9" returned: 0 in 0.565s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:32 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9 Sep 23 00:31:32 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:32 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567.d0c0a9bb-1240-4b00-85d5-59c7f18747f9" returned: 0 in 0.375s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Lock "cinder-quobyte-d0c0a9bb-1240-4b00-85d5-59c7f18747f9" released by "_delete_snapshot" :: held 2.337s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Lock "cinder-quobyte-030b6ff1-19d4-4f63-b93e-16dbbd897567" released by "delete_snapshot" :: held 2.374s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:32 devstack cinder-volume[87138]: WARNING cinder.quota [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2023964216 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2023964216, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:32 devstack cinder-volume[87138]: WARNING cinder.quota [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2023964216 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2023964216, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:32 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] Created reservations ['aeb7c040-908e-4616-a49d-5b89e35bcbca', 'a75abb1b-66d3-4360-9f05-3da4c16fa59a', '0bd96aa5-a026-4d97-81cc-c4996473cea1', 'dcda4722-5203-4fd1-927f-1fedf84c40b6', '79e96411-aa89-4a05-831d-ae10481a1e14'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-56cc2bb9-84ce-4f99-b1cb-aa5488a50f1b tempest-GroupSnapshotsV319Test-324303415 None] group_snapshot 23b88dfd-8d7e-4adf-8a34-4970a1883360: deleted successfully Sep 23 00:31:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Acquiring lock "cinder-quobyte-030b6ff1-19d4-4f63-b93e-16dbbd897567" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Lock "cinder-quobyte-030b6ff1-19d4-4f63-b93e-16dbbd897567" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[50669fbf-c6f3-4cae-b47a-211c38496805]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 Sep 23 00:31:34 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Flow 'volume_create_manager' (ee04acb8-6a9a-46da-a804-551b783e5f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaa208a-0adc-418b-b03a-f227e10757c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aaa208a-0adc-418b-b03a-f227e10757c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89352894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e3899d-58b4-448c-98e6-0e41bb25af37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb852aa80c8452b82561c834f70e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:34Z,use_quota=True,user_id='a0b12cd6f1684899bbcdba64cf103fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747b65dd-21b7-414d-8cdb-74fe1b209cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747b65dd-21b7-414d-8cdb-74fe1b209cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64e1168-d1d4-4e17-82f7-5aa77978fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64e1168-d1d4-4e17-82f7-5aa77978fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e3899d-58b4-448c-98e6-0e41bb25af37', 'volume_name': 'volume-56e3899d-58b4-448c-98e6-0e41bb25af37', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5131ca2-582f-4969-8298-c4cec595fdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5131ca2-582f-4969-8298-c4cec595fdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f47d3f-73b0-4c56-a329-36fac10c01c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:34 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Volume 56e3899d-58b4-448c-98e6-0e41bb25af37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e3899d-58b4-448c-98e6-0e41bb25af37', 'volume_size': 1} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-89352894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e3899d-58b4-448c-98e6-0e41bb25af37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb852aa80c8452b82561c834f70e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:34Z,use_quota=True,user_id='a0b12cd6f1684899bbcdba64cf103fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Creating volume 56e3899d-58b4-448c-98e6-0e41bb25af37 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:34 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37 1073741824 Sep 23 00:31:34 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567" returned: 0 in 0.524s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:34 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567 Sep 23 00:31:34 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:34 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-030b6ff1-19d4-4f63-b93e-16dbbd897567" returned: 0 in 0.352s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Lock "cinder-quobyte-030b6ff1-19d4-4f63-b93e-16dbbd897567" released by "delete_volume" :: held 1.003s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Created reservations ['a70cc489-8808-4735-a875-8ab6c7e8553d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:35 devstack cinder-volume[87138]: WARNING cinder.quota [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2023964216 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2023964216, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:31:35 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37 1073741824" returned: 0 in 0.626s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Created reservations ['848ec5c3-8c03-4705-a884-86875ea39072', '1121d9b1-31a7-4ce6-ac4c-3935938d4028', 'ac3f1194-239e-46ab-9806-0c9283d0c16d', 'cf0045a6-08da-4227-963a-05678894ad54', 'da7f9744-19ee-45c6-8599-9c95bf0d07e0'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:35 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37 Sep 23 00:31:35 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:35 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:35 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:35 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37" returned: 0 in 0.368s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f47d3f-73b0-4c56-a329-36fac10c01c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e3899d-58b4-448c-98e6-0e41bb25af37', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dea342d-172e-4007-8911-de69760a1d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Volume volume-56e3899d-58b4-448c-98e6-0e41bb25af37 (56e3899d-58b4-448c-98e6-0e41bb25af37): created successfully Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dea342d-172e-4007-8911-de69760a1d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Flow 'volume_create_manager' (ee04acb8-6a9a-46da-a804-551b783e5f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-38a06acc-26dc-4e4d-a14f-5ef46174c943 tempest-ProjectReaderTests-1751419990 None] Created volume successfully. Sep 23 00:31:35 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.315s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:35 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9409c424-7687-4280-9fb4-a42a59d0d369 tempest-GroupSnapshotsV319Test-324303415 None] Delete group completed successfully. Sep 23 00:31:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "cinder-56e3899d-58b4-448c-98e6-0e41bb25af37-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-56e3899d-58b4-448c-98e6-0e41bb25af37-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "cinder-quobyte-56e3899d-58b4-448c-98e6-0e41bb25af37" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-quobyte-56e3899d-58b4-448c-98e6-0e41bb25af37" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:37 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bdbc26-5964-49e0-8a94-36ced25d57a1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:37 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37 Sep 23 00:31:37 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:37 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37" returned: 0 in 0.547s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:37 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37 Sep 23 00:31:37 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:38 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-56e3899d-58b4-448c-98e6-0e41bb25af37" returned: 0 in 0.345s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-quobyte-56e3899d-58b4-448c-98e6-0e41bb25af37" released by "delete_volume" :: held 0.976s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Created reservations ['c36bad95-9aa9-4c64-a596-a35d928a41f5', 'ad2bbe1d-e9d8-431c-96ed-a10a33c60438', '6d2dda0f-4f24-4c44-921a-45a39cb41421', '49482e1a-ee50-44d0-9972-a983132e8e78', '0653de09-94ca-4e82-b555-d88825de16f2'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:38 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:38 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:38 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.357s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:38 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Deleted volume successfully. Sep 23 00:31:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6b89986b-9493-49e8-8535-2ebe22e3dc13 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-56e3899d-58b4-448c-98e6-0e41bb25af37-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Flow 'volume_create_manager' (9f2a222e-bba1-42c5-ba8f-e3d4448d0aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f916b59-ddab-4a04-9fa5-09b5090d842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f916b59-ddab-4a04-9fa5-09b5090d842e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91593316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b811eec3-7a5b-40cf-9d88-447bb27ad176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb852aa80c8452b82561c834f70e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:40Z,use_quota=True,user_id='a0b12cd6f1684899bbcdba64cf103fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d67f6bc-8f3e-4e94-a823-5b3e96cfc788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d67f6bc-8f3e-4e94-a823-5b3e96cfc788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a55ac0-1136-4558-bac6-44598d44d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65a55ac0-1136-4558-bac6-44598d44d49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b811eec3-7a5b-40cf-9d88-447bb27ad176', 'volume_name': 'volume-b811eec3-7a5b-40cf-9d88-447bb27ad176', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631ac869-1556-4db7-b508-eb8ff9b95cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631ac869-1556-4db7-b508-eb8ff9b95cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706926d3-6185-4ae6-bb20-3f4f5749364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:40 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Volume b811eec3-7a5b-40cf-9d88-447bb27ad176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b811eec3-7a5b-40cf-9d88-447bb27ad176', 'volume_size': 1} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-91593316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b811eec3-7a5b-40cf-9d88-447bb27ad176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb852aa80c8452b82561c834f70e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:40Z,use_quota=True,user_id='a0b12cd6f1684899bbcdba64cf103fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Creating volume b811eec3-7a5b-40cf-9d88-447bb27ad176 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:40 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:40 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 1073741824 Sep 23 00:31:40 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:41 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 1073741824" returned: 0 in 0.692s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:41 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 Sep 23 00:31:41 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:41 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176" returned: 0 in 0.290s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706926d3-6185-4ae6-bb20-3f4f5749364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b811eec3-7a5b-40cf-9d88-447bb27ad176', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a01fa47-ab6b-4e3c-9718-59d6256d2665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Volume volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 (b811eec3-7a5b-40cf-9d88-447bb27ad176): created successfully Sep 23 00:31:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a01fa47-ab6b-4e3c-9718-59d6256d2665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Flow 'volume_create_manager' (9f2a222e-bba1-42c5-ba8f-e3d4448d0aea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:41 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-85e0b363-e51c-42e4-b769-143e47520a24 tempest-ProjectReaderTests-1751419990 None] Created volume successfully. Sep 23 00:31:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "cinder-b811eec3-7a5b-40cf-9d88-447bb27ad176-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-b811eec3-7a5b-40cf-9d88-447bb27ad176-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "cinder-quobyte-b811eec3-7a5b-40cf-9d88-447bb27ad176" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-quobyte-b811eec3-7a5b-40cf-9d88-447bb27ad176" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:42 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7017eac7-c92d-48cf-ac71-54b58f4909c6]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:42 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 Sep 23 00:31:42 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:43 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176" returned: 0 in 0.581s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:43 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176 Sep 23 00:31:43 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:43 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b811eec3-7a5b-40cf-9d88-447bb27ad176" returned: 0 in 0.309s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-quobyte-b811eec3-7a5b-40cf-9d88-447bb27ad176" released by "delete_volume" :: held 0.958s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Created reservations ['957b2ec8-1ce9-44c7-a703-3d483403d855', 'b064e639-ddbf-47fb-a2f8-3e539e7cd0b9', '719b5f18-bc80-4843-b999-69a64d75ba46', '78ba3bab-127d-4813-86af-5309593f134d', '5512da86-fcb6-43d7-a22b-4182006b2a01'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:43 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:43 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:44 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.343s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:44 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:44 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Deleted volume successfully. Sep 23 00:31:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-445d997f-97b6-46d5-9745-e7d6d74a33d6 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-b811eec3-7a5b-40cf-9d88-447bb27ad176-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Flow 'volume_create_manager' (1ed2acb1-08e6-4dfa-9add-afa36cb5d52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96f3a18-ab85-41f7-827a-b34d1c251b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d96f3a18-ab85-41f7-827a-b34d1c251b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072162381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8b2fe9-e030-4ed6-84e6-fde7713e4349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb852aa80c8452b82561c834f70e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:45Z,use_quota=True,user_id='a0b12cd6f1684899bbcdba64cf103fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0999aa-60ec-404a-bd61-a50aeedfe9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0999aa-60ec-404a-bd61-a50aeedfe9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed82fcd0-4f8f-40f2-a075-1321d8fec8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed82fcd0-4f8f-40f2-a075-1321d8fec8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf8b2fe9-e030-4ed6-84e6-fde7713e4349', 'volume_name': 'volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f97d896-2b2f-4751-bea9-f39337eeaf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f97d896-2b2f-4751-bea9-f39337eeaf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878eaf3a-175e-4a26-bda9-44679a186ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Volume bf8b2fe9-e030-4ed6-84e6-fde7713e4349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349', 'volume_size': 1} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072162381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf8b2fe9-e030-4ed6-84e6-fde7713e4349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb852aa80c8452b82561c834f70e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:45Z,use_quota=True,user_id='a0b12cd6f1684899bbcdba64cf103fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Creating volume bf8b2fe9-e030-4ed6-84e6-fde7713e4349 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:45 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:45 devstack sudo[104474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 1073741824 Sep 23 00:31:45 devstack sudo[104474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:46 devstack sudo[104474]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 1073741824" returned: 0 in 0.629s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:46 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 Sep 23 00:31:46 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:46 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349" returned: 0 in 0.322s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878eaf3a-175e-4a26-bda9-44679a186ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d1dc8c-1ddb-4784-ace8-5eecd9383cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:46 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Volume volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 (bf8b2fe9-e030-4ed6-84e6-fde7713e4349): created successfully Sep 23 00:31:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d1dc8c-1ddb-4784-ace8-5eecd9383cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Flow 'volume_create_manager' (1ed2acb1-08e6-4dfa-9add-afa36cb5d52a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ffe897a4-f78a-40ab-91f1-7b6a6852081f tempest-ProjectReaderTests-1751419990 None] Created volume successfully. Sep 23 00:31:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "cinder-bf8b2fe9-e030-4ed6-84e6-fde7713e4349-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-bf8b2fe9-e030-4ed6-84e6-fde7713e4349-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "cinder-quobyte-bf8b2fe9-e030-4ed6-84e6-fde7713e4349" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-quobyte-bf8b2fe9-e030-4ed6-84e6-fde7713e4349" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3386a506-5e87-4ebf-ae88-637bb05bec71]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:47 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 Sep 23 00:31:47 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:48 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349" returned: 0 in 0.596s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:48 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349 Sep 23 00:31:48 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:48 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-bf8b2fe9-e030-4ed6-84e6-fde7713e4349" returned: 0 in 0.378s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-quobyte-bf8b2fe9-e030-4ed6-84e6-fde7713e4349" released by "delete_volume" :: held 1.048s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:48 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Created reservations ['58653f30-584f-4316-84bf-a2a074248a9f', '73ec6ac1-bd86-49ca-9b1a-7b47fd41170e', 'd6761d08-a14d-45a4-86d7-dd2ac3b3e8c8', '09b6a40f-30a1-414d-a3ff-5dee69e9f1b9', '89f82cfc-91e0-4359-9a1b-1ed04e74551e'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:49 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:49 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:49 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.355s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:49 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Deleted volume successfully. Sep 23 00:31:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3245ed73-344a-4357-a984-00ee9e1a3903 tempest-ProjectReaderTests-1751419990 None] Lock "cinder-bf8b2fe9-e030-4ed6-84e6-fde7713e4349-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Flow 'volume_create_manager' (18d4f2b5-3b20-4276-9d6f-c4beec500a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a2cf3c-d9ee-45ae-b898-6316490d5386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a2cf3c-d9ee-45ae-b898-6316490d5386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066413392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee45ac45-ccf9-4a15-9f55-3cd9f4153d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb852aa80c8452b82561c834f70e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:51Z,use_quota=True,user_id='a0b12cd6f1684899bbcdba64cf103fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddbc0c5-0f45-484b-87e8-f8570bdc6d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddbc0c5-0f45-484b-87e8-f8570bdc6d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99ea550-1512-409a-9fe9-8e814fcf2efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e99ea550-1512-409a-9fe9-8e814fcf2efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee45ac45-ccf9-4a15-9f55-3cd9f4153d58', 'volume_name': 'volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a0db77-e8e3-4a04-a11d-58b209840ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86a0db77-e8e3-4a04-a11d-58b209840ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492f5fd3-9c62-470a-8ba8-7797b4fe4a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:50 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Volume ee45ac45-ccf9-4a15-9f55-3cd9f4153d58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58', 'volume_size': 1} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2066413392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee45ac45-ccf9-4a15-9f55-3cd9f4153d58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb852aa80c8452b82561c834f70e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:51Z,use_quota=True,user_id='a0b12cd6f1684899bbcdba64cf103fbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Creating volume ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:50 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:50 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 1073741824 Sep 23 00:31:50 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:51 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 1073741824" returned: 0 in 0.593s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:51 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 Sep 23 00:31:51 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:51 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58" returned: 0 in 0.347s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492f5fd3-9c62-470a-8ba8-7797b4fe4a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f8b574-27ec-433a-b21b-77f4aded266a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:51 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Volume volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 (ee45ac45-ccf9-4a15-9f55-3cd9f4153d58): created successfully Sep 23 00:31:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f8b574-27ec-433a-b21b-77f4aded266a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Flow 'volume_create_manager' (18d4f2b5-3b20-4276-9d6f-c4beec500a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-68801508-c7e0-4436-85f1-a9fda56bdedf tempest-ProjectReaderTests-1751419990 None] Created volume successfully. Sep 23 00:31:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Acquiring lock "cinder-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Lock "cinder-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Acquiring lock "cinder-quobyte-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Lock "cinder-quobyte-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:52 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd190ced-8845-4dd9-a077-46cfd104cd26]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:53 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 Sep 23 00:31:53 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:53 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58" returned: 0 in 0.457s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:53 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58 Sep 23 00:31:53 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:53 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58" returned: 0 in 0.377s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Lock "cinder-quobyte-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58" released by "delete_volume" :: held 0.903s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:53 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Created reservations ['69b5296d-e336-4b35-9671-6516cd60fb83', 'c5f97569-69b5-47ea-acaa-6c7184813f35', '7d9a2b63-4958-4d8a-a423-d5f82b8fb5d5', '518aaf30-8ac4-4162-a8e1-3cadad4d8371', '1cb4101f-cd96-45f6-bf97-bb903311c050'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Flow 'volume_create_manager' (f365e908-53f4-4099-a14e-89cb8b4fbfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40b8018-d46d-426a-be09-237ba2dbece1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:54 devstack sudo[104511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:54 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40b8018-d46d-426a-be09-237ba2dbece1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1399067932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566a361e-7e25-4672-814f-c41fa7b2236e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf37c5437494c94b9239f2f918cf5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:54Z,use_quota=True,user_id='42b9aec7b9c048e5b40e7dbfc64fbf74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82aa9781-ebb1-4ead-a21d-0ea5edba1f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82aa9781-ebb1-4ead-a21d-0ea5edba1f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb83161c-ddfe-4e6d-ac49-59479b1ceac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb83161c-ddfe-4e6d-ac49-59479b1ceac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566a361e-7e25-4672-814f-c41fa7b2236e', 'volume_name': 'volume-566a361e-7e25-4672-814f-c41fa7b2236e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f410c685-ca62-49b6-8b60-ff2e5ca8bff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f410c685-ca62-49b6-8b60-ff2e5ca8bff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36adaade-e96e-4d2b-8bfd-cc82ecb60c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:54 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Volume 566a361e-7e25-4672-814f-c41fa7b2236e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566a361e-7e25-4672-814f-c41fa7b2236e', 'volume_size': 1} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:31:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1399067932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566a361e-7e25-4672-814f-c41fa7b2236e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf37c5437494c94b9239f2f918cf5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:31:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:31:54Z,use_quota=True,user_id='42b9aec7b9c048e5b40e7dbfc64fbf74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Creating volume 566a361e-7e25-4672-814f-c41fa7b2236e {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:31:54 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:54 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e 1073741824 Sep 23 00:31:54 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:54 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.269s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Deleted volume successfully. Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1274b1dd-69d0-4599-8875-7e8a94a7ca0d tempest-ProjectReaderTests-1751419990 None] Lock "cinder-ee45ac45-ccf9-4a15-9f55-3cd9f4153d58-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:54 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e 1073741824" returned: 0 in 0.515s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:54 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e Sep 23 00:31:54 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:55 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e" returned: 0 in 0.345s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:31:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36adaade-e96e-4d2b-8bfd-cc82ecb60c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566a361e-7e25-4672-814f-c41fa7b2236e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e674829-cb66-4853-81b7-891119d83e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:31:55 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Volume volume-566a361e-7e25-4672-814f-c41fa7b2236e (566a361e-7e25-4672-814f-c41fa7b2236e): created successfully Sep 23 00:31:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e674829-cb66-4853-81b7-891119d83e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:31:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Flow 'volume_create_manager' (f365e908-53f4-4099-a14e-89cb8b4fbfb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:31:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-01843bb5-258f-4638-8404-4b339b6b0163 tempest-VolumesServicesTestJSON-2042976728 None] Created volume successfully. Sep 23 00:31:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Acquiring lock "cinder-566a361e-7e25-4672-814f-c41fa7b2236e-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Lock "cinder-566a361e-7e25-4672-814f-c41fa7b2236e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Acquiring lock "cinder-quobyte-566a361e-7e25-4672-814f-c41fa7b2236e" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:31:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Lock "cinder-quobyte-566a361e-7e25-4672-814f-c41fa7b2236e" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:31:56 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ceda5-8b86-49b2-a30f-ecfd43e9474d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:31:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:56 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e Sep 23 00:31:56 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:57 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e" returned: 0 in 0.527s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:57 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e Sep 23 00:31:57 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:57 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-566a361e-7e25-4672-814f-c41fa7b2236e" returned: 0 in 0.339s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Lock "cinder-quobyte-566a361e-7e25-4672-814f-c41fa7b2236e" released by "delete_volume" :: held 0.929s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Created reservations ['bc614f82-f882-4c30-806b-c3282c449ac4', '0f201da4-57ef-4031-a5f2-2f2a496200ec', '7e47884b-2436-48b9-8662-f0a2eca940b3', 'f8afb292-cf73-4103-8a06-7a64f6068eaf', '80127dc9-ac1e-475e-a39f-f9487f2bfd2b'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:31:57 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:31:57 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:31:57 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.331s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:31:57 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:31:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Deleted volume successfully. Sep 23 00:31:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1fb346cb-ff3e-4c96-9ee0-0776f2a9bb39 tempest-VolumesServicesTestJSON-2042976728 None] Lock "cinder-566a361e-7e25-4672-814f-c41fa7b2236e-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:02 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:32:02 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:03 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.354s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:32:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:32:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Flow 'volume_create_manager' (5db8d658-9dff-4e27-82f7-624f892260db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2806b1c-1cd8-43e9-b63f-187ec53a46be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2806b1c-1cd8-43e9-b63f-187ec53a46be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-449442159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3860aac7-0777-47f3-9f7f-76edb691c59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97a39acabc14f0da313d34e02151063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:05Z,use_quota=True,user_id='f5ab3672cf664b38869d83af2435ac2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(946f96fa-cc7f-41fa-a728-96257a9b6377),volume_type_id=946f96fa-cc7f-41fa-a728-96257a9b6377)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d4d11a-4572-4be3-83e7-59568be1aa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d4d11a-4572-4be3-83e7-59568be1aa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e2a276-5b9e-47ed-8615-968d327efb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e2a276-5b9e-47ed-8615-968d327efb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3860aac7-0777-47f3-9f7f-76edb691c59d', 'volume_name': 'volume-3860aac7-0777-47f3-9f7f-76edb691c59d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef11422-74ed-49f8-9d22-00c1fe38e2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ef11422-74ed-49f8-9d22-00c1fe38e2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5134e9-b346-412f-b8b4-b17392974cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:05 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Volume 3860aac7-0777-47f3-9f7f-76edb691c59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3860aac7-0777-47f3-9f7f-76edb691c59d', 'volume_size': 1} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-449442159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3860aac7-0777-47f3-9f7f-76edb691c59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97a39acabc14f0da313d34e02151063',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:05Z,use_quota=True,user_id='f5ab3672cf664b38869d83af2435ac2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(946f96fa-cc7f-41fa-a728-96257a9b6377),volume_type_id=946f96fa-cc7f-41fa-a728-96257a9b6377)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Creating volume 3860aac7-0777-47f3-9f7f-76edb691c59d {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:05 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:32:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:05 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d 1073741824 Sep 23 00:32:05 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:06 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d 1073741824" returned: 0 in 0.525s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:06 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d Sep 23 00:32:06 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:06 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d" returned: 0 in 0.282s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5134e9-b346-412f-b8b4-b17392974cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3860aac7-0777-47f3-9f7f-76edb691c59d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69adc970-36bd-469c-8fbd-63b6ec357233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:06 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Volume volume-3860aac7-0777-47f3-9f7f-76edb691c59d (3860aac7-0777-47f3-9f7f-76edb691c59d): created successfully Sep 23 00:32:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69adc970-36bd-469c-8fbd-63b6ec357233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Flow 'volume_create_manager' (5db8d658-9dff-4e27-82f7-624f892260db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-85fc6339-aeaf-418f-84a2-b28d5dc9e4fa tempest-VolumeTypesAccessTest-1716481709 None] Created volume successfully. Sep 23 00:32:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Acquiring lock "cinder-3860aac7-0777-47f3-9f7f-76edb691c59d-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Lock "cinder-3860aac7-0777-47f3-9f7f-76edb691c59d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Acquiring lock "cinder-quobyte-3860aac7-0777-47f3-9f7f-76edb691c59d" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Lock "cinder-quobyte-3860aac7-0777-47f3-9f7f-76edb691c59d" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:07 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b84f5-b37e-4ea3-ae07-df12c8ebff9c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:07 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d Sep 23 00:32:07 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:08 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d" returned: 0 in 0.481s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d Sep 23 00:32:08 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:08 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3860aac7-0777-47f3-9f7f-76edb691c59d" returned: 0 in 0.315s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Lock "cinder-quobyte-3860aac7-0777-47f3-9f7f-76edb691c59d" released by "delete_volume" :: held 0.852s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:08 devstack cinder-volume[87138]: WARNING cinder.quota [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-322101061 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-322101061, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:32:08 devstack cinder-volume[87138]: WARNING cinder.quota [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-322101061 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-322101061, it is now deprecated. Please use the default quota class for default quota. Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Created reservations ['7366918d-22f5-4662-b336-c06fbd49a14c', 'c4cf39e1-b4a9-4dd5-8a27-6d4ac8cf43d7', 'a11bb318-fdfe-4183-8b29-319ca58dc475', '3cde7471-5818-447c-a122-628d88887fc8', '49a52857-d712-4ca7-b3ee-330889467589'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:08 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:32:08 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:09 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.328s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:09 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Deleted volume successfully. Sep 23 00:32:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fff4c86d-93f1-4558-b335-557745308123 tempest-VolumeTypesAccessTest-1716481709 None] Lock "cinder-3860aac7-0777-47f3-9f7f-76edb691c59d-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:18 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=97,cinder:INSERT=36,cinder:UPDATE=128,cinder:DELETE=10 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=139,cinder:SELECT=103,cinder:DELETE=8,cinder:INSERT=34 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (43a19d54-98d3-444d-9ce6-36860da50269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e702a6bf-1a80-4e3f-acda-8f43848adfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e702a6bf-1a80-4e3f-acda-8f43848adfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-695604872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114c281c-16a2-4745-a00b-617a43ab8709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:54Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83d1a31-28ca-427f-9108-09dda0052399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83d1a31-28ca-427f-9108-09dda0052399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25c9c53-54b0-4971-a2db-3945f62ef12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25c9c53-54b0-4971-a2db-3945f62ef12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114c281c-16a2-4745-a00b-617a43ab8709', 'volume_name': 'volume-114c281c-16a2-4745-a00b-617a43ab8709', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318e28cd-2861-4083-b9aa-af1650d57c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318e28cd-2861-4083-b9aa-af1650d57c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532955b8-e195-42a2-9b12-f4405a49c493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:54 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Volume 114c281c-16a2-4745-a00b-617a43ab8709: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114c281c-16a2-4745-a00b-617a43ab8709', 'volume_size': 1} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-695604872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114c281c-16a2-4745-a00b-617a43ab8709,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:32:54Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Creating volume 114c281c-16a2-4745-a00b-617a43ab8709 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:32:54 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:54 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709 1073741824 Sep 23 00:32:54 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:54 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709 1073741824" returned: 0 in 0.524s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:55 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709 Sep 23 00:32:55 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:55 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709" returned: 0 in 0.322s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:32:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (532955b8-e195-42a2-9b12-f4405a49c493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114c281c-16a2-4745-a00b-617a43ab8709', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d18024-7f56-4681-8cea-cf4572bf9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:32:55 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Volume volume-114c281c-16a2-4745-a00b-617a43ab8709 (114c281c-16a2-4745-a00b-617a43ab8709): created successfully Sep 23 00:32:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d18024-7f56-4681-8cea-cf4572bf9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:32:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (43a19d54-98d3-444d-9ce6-36860da50269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:32:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9f8bac23-540d-46bf-88f3-f79c090e0110 tempest-VolumesActionsTest-2109691683 None] Created volume successfully. Sep 23 00:32:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb6c47a2-96ba-4da8-8d23-5dce2a5a7950 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709" by "attach_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb6c47a2-96ba-4da8-8d23-5dce2a5a7950 tempest-VolumesActionsTest-2109691683 None] Lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709" acquired by "attach_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bb6c47a2-96ba-4da8-8d23-5dce2a5a7950 tempest-VolumesActionsTest-2109691683 None] Attaching volume 114c281c-16a2-4745-a00b-617a43ab8709 to instance f293d4b3-e8ff-4435-bcd6-c4cc4eeabe34 at mountpoint /dev/vdb on host None. Sep 23 00:32:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bb6c47a2-96ba-4da8-8d23-5dce2a5a7950 tempest-VolumesActionsTest-2109691683 None] Attach volume completed successfully. Sep 23 00:32:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb6c47a2-96ba-4da8-8d23-5dce2a5a7950 tempest-VolumesActionsTest-2109691683 None] Lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709" released by "attach_volume" :: held 0.128s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a5cf705e-13e5-4c4d-a5b8-b72dbdbdc3e9 tempest-VolumesActionsTest-1535604417 None] Terminate volume connection completed successfully. Sep 23 00:32:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a5cf705e-13e5-4c4d-a5b8-b72dbdbdc3e9 tempest-VolumesActionsTest-1535604417 None] Acquiring lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709-detach_volume" by "detach_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a5cf705e-13e5-4c4d-a5b8-b72dbdbdc3e9 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a5cf705e-13e5-4c4d-a5b8-b72dbdbdc3e9 tempest-VolumesActionsTest-1535604417 None] Detaching volume 114c281c-16a2-4745-a00b-617a43ab8709 from instance f293d4b3-e8ff-4435-bcd6-c4cc4eeabe34. Sep 23 00:32:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a5cf705e-13e5-4c4d-a5b8-b72dbdbdc3e9 tempest-VolumesActionsTest-1535604417 None] Detach volume completed successfully. Sep 23 00:32:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a5cf705e-13e5-4c4d-a5b8-b72dbdbdc3e9 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-332f5789-21ab-431e-a253-12e532c9ee21 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709-detach_volume" by "detach_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-332f5789-21ab-431e-a253-12e532c9ee21 tempest-VolumesActionsTest-2109691683 None] Lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-332f5789-21ab-431e-a253-12e532c9ee21 tempest-VolumesActionsTest-2109691683 None] Volume detach called, but volume not attached. Sep 23 00:32:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-332f5789-21ab-431e-a253-12e532c9ee21 tempest-VolumesActionsTest-2109691683 None] Lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Acquiring lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Acquiring lock "cinder-quobyte-114c281c-16a2-4745-a00b-617a43ab8709" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Lock "cinder-quobyte-114c281c-16a2-4745-a00b-617a43ab8709" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a460b9c-ee17-4519-b893-57c5c7350d43]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709 Sep 23 00:32:58 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709" returned: 0 in 0.451s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:58 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709 Sep 23 00:32:58 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:58 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-114c281c-16a2-4745-a00b-617a43ab8709" returned: 0 in 0.273s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Lock "cinder-quobyte-114c281c-16a2-4745-a00b-617a43ab8709" released by "delete_volume" :: held 0.794s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Created reservations ['3f5190a6-f594-4b83-ab0a-e889947e9b63', '9cb462d1-5c74-4d35-a95e-0dd8dd17cb0f', '25a96c53-a365-48e5-9ed4-c60185ac29eb', '24bdaed8-14c3-40da-b8e6-f9d29adb36f5', '6c61256f-3236-49fe-892b-6eaf92ed6b85'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:32:59 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:32:59 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:32:59 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.409s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:32:59 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Deleted volume successfully. Sep 23 00:32:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-74f7b3ee-7f7d-4ee2-a529-1d785bb0976e tempest-VolumesActionsTest-2109691683 None] Lock "cinder-114c281c-16a2-4745-a00b-617a43ab8709-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:02 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:33:02 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (452a3b98-f7eb-494c-9283-40d04ba9d24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c079cfe0-6751-44a2-a226-30a6f1b90f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c079cfe0-6751-44a2-a226-30a6f1b90f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-145294999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f745fe-fef3-483f-81bc-5fe923769940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:03Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a93f9f-3dfc-49cb-8f6a-d3d5a8774771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a93f9f-3dfc-49cb-8f6a-d3d5a8774771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2248aa90-b5c3-41d4-857f-8f92bd932193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2248aa90-b5c3-41d4-857f-8f92bd932193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f745fe-fef3-483f-81bc-5fe923769940', 'volume_name': 'volume-d7f745fe-fef3-483f-81bc-5fe923769940', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25479da0-98dc-42ca-bbf2-f9bc4206fd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25479da0-98dc-42ca-bbf2-f9bc4206fd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f83bb5-bfea-47c3-a16f-aedcf7fe0625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:03 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Volume d7f745fe-fef3-483f-81bc-5fe923769940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f745fe-fef3-483f-81bc-5fe923769940', 'volume_size': 1} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-145294999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f745fe-fef3-483f-81bc-5fe923769940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:03Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Creating volume d7f745fe-fef3-483f-81bc-5fe923769940 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:03 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:03 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940 1073741824 Sep 23 00:33:03 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:03 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.381s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:33:03 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940 1073741824" returned: 0 in 0.523s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:03 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940 Sep 23 00:33:03 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:03 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940" returned: 0 in 0.302s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9f83bb5-bfea-47c3-a16f-aedcf7fe0625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f745fe-fef3-483f-81bc-5fe923769940', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854f3dd9-2a7a-409e-93f8-c7d45fef7222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:03 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Volume volume-d7f745fe-fef3-483f-81bc-5fe923769940 (d7f745fe-fef3-483f-81bc-5fe923769940): created successfully Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854f3dd9-2a7a-409e-93f8-c7d45fef7222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (452a3b98-f7eb-494c-9283-40d04ba9d24c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:04 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-19b8d7f5-6210-425d-b462-18d147493984 tempest-VolumesActionsTest-2109691683 None] Created volume successfully. Sep 23 00:33:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Acquiring lock "cinder-d7f745fe-fef3-483f-81bc-5fe923769940-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-d7f745fe-fef3-483f-81bc-5fe923769940-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Acquiring lock "cinder-quobyte-d7f745fe-fef3-483f-81bc-5fe923769940" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-quobyte-d7f745fe-fef3-483f-81bc-5fe923769940" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:05 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e386b38-68f3-4211-afa0-fd8a6f602cc0]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940 Sep 23 00:33:05 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:05 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940" returned: 0 in 0.420s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:05 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940 Sep 23 00:33:05 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d7f745fe-fef3-483f-81bc-5fe923769940" returned: 0 in 0.320s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-quobyte-d7f745fe-fef3-483f-81bc-5fe923769940" released by "delete_volume" :: held 0.790s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Created reservations ['ccf0c8f6-59b1-4ae0-ad4d-18f01468a9f5', 'e2faf55c-bb8d-4527-a82c-b9db7a97a6a6', '45aa892c-029b-4ee3-98bf-e11b05a33cf0', '09d2350e-a29f-4b26-bdb8-8e663087b7df', '682f0a3d-af9b-4949-ab5f-41873b3a2039'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:06 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:33:06 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:06 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.334s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Deleted volume successfully. Sep 23 00:33:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ada1ca4a-c90b-4459-b53d-4bb061ae6cb1 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-d7f745fe-fef3-483f-81bc-5fe923769940-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (a37c9b05-8914-4dba-85ee-4d80eabfff24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42015e8d-7605-46a7-8751-29a4a801912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42015e8d-7605-46a7-8751-29a4a801912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116425692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28a1f1a-b358-4452-8551-32f7860f8d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:07Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49d6851-cc9b-403f-963d-77372ff2aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f49d6851-cc9b-403f-963d-77372ff2aa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac003b0e-8d32-4c16-b3cf-1d61b0158e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac003b0e-8d32-4c16-b3cf-1d61b0158e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28a1f1a-b358-4452-8551-32f7860f8d6d', 'volume_name': 'volume-f28a1f1a-b358-4452-8551-32f7860f8d6d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378df319-9fbe-4c55-b70e-0bac8ce9dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378df319-9fbe-4c55-b70e-0bac8ce9dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6573906f-9292-4521-a239-3689ce10250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:07 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Volume f28a1f1a-b358-4452-8551-32f7860f8d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28a1f1a-b358-4452-8551-32f7860f8d6d', 'volume_size': 1} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2116425692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28a1f1a-b358-4452-8551-32f7860f8d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:07Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Creating volume f28a1f1a-b358-4452-8551-32f7860f8d6d {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:07 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d 1073741824 Sep 23 00:33:07 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:07 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d 1073741824" returned: 0 in 0.519s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:07 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d Sep 23 00:33:07 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:08 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d" returned: 0 in 0.297s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6573906f-9292-4521-a239-3689ce10250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28a1f1a-b358-4452-8551-32f7860f8d6d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2652ed8d-c690-46c6-a2bb-c8e00ae6c292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:08 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Volume volume-f28a1f1a-b358-4452-8551-32f7860f8d6d (f28a1f1a-b358-4452-8551-32f7860f8d6d): created successfully Sep 23 00:33:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2652ed8d-c690-46c6-a2bb-c8e00ae6c292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (a37c9b05-8914-4dba-85ee-4d80eabfff24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f48c7934-7bd6-4d88-be0b-30e953ca5394 tempest-VolumesActionsTest-2109691683 None] Created volume successfully. Sep 23 00:33:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Acquiring lock "cinder-f28a1f1a-b358-4452-8551-32f7860f8d6d-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Lock "cinder-f28a1f1a-b358-4452-8551-32f7860f8d6d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Acquiring lock "cinder-quobyte-f28a1f1a-b358-4452-8551-32f7860f8d6d" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Lock "cinder-quobyte-f28a1f1a-b358-4452-8551-32f7860f8d6d" acquired by "delete_volume" :: waited 0.015s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:09 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d490105-6a93-4cbf-9a0a-15c582dcf190]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:09 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d Sep 23 00:33:09 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:09 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d" returned: 0 in 0.391s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:09 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d Sep 23 00:33:09 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f28a1f1a-b358-4452-8551-32f7860f8d6d" returned: 0 in 0.283s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Lock "cinder-quobyte-f28a1f1a-b358-4452-8551-32f7860f8d6d" released by "delete_volume" :: held 0.719s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Created reservations ['8a07c786-ad0b-4203-929f-82c26295e639', '3f00dda0-93a2-43f7-8bff-c34f3ff02679', 'f4d97940-f0ec-4ef7-bf69-d9768af35eaa', '996bb847-c132-4311-bcb8-25cd7e68e75e', 'ca1cb79f-6df2-496a-9573-bf31b38eefdf'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:10 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:33:10 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:10 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.284s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Deleted volume successfully. Sep 23 00:33:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9c268d78-7813-4d88-8427-57facbbf4c7d tempest-VolumesActionsTest-1535604417 None] Lock "cinder-f28a1f1a-b358-4452-8551-32f7860f8d6d-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (3ddb9485-8c3c-403c-836d-35f93ad4bbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebe1d68-20fd-407e-9eec-a545925ca7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ebe1d68-20fd-407e-9eec-a545925ca7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1966165985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4552cac1-9aeb-4526-9d22-949139a4c7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:11Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1c0a1b-1ae2-4b9e-b556-d7ec796455ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac1c0a1b-1ae2-4b9e-b556-d7ec796455ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efde29a0-555c-40b2-82ea-c457fd629c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efde29a0-555c-40b2-82ea-c457fd629c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4552cac1-9aeb-4526-9d22-949139a4c7e1', 'volume_name': 'volume-4552cac1-9aeb-4526-9d22-949139a4c7e1', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd4ed38-9fcc-4307-9075-cc5fa584d1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd4ed38-9fcc-4307-9075-cc5fa584d1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5459f32b-a86c-487c-8713-a413adc2125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:11 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Volume 4552cac1-9aeb-4526-9d22-949139a4c7e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4552cac1-9aeb-4526-9d22-949139a4c7e1', 'volume_size': 1} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1966165985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4552cac1-9aeb-4526-9d22-949139a4c7e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:11Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Creating volume 4552cac1-9aeb-4526-9d22-949139a4c7e1 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:11 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[104786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 1073741824 Sep 23 00:33:11 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:11 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 1073741824" returned: 0 in 0.495s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:11 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 Sep 23 00:33:11 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:12 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1" returned: 0 in 0.275s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:12 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5459f32b-a86c-487c-8713-a413adc2125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4552cac1-9aeb-4526-9d22-949139a4c7e1', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647b65b6-1b67-40a9-a629-b7d2b77c95f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:12 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Volume volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 (4552cac1-9aeb-4526-9d22-949139a4c7e1): created successfully Sep 23 00:33:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (647b65b6-1b67-40a9-a629-b7d2b77c95f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (3ddb9485-8c3c-403c-836d-35f93ad4bbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:12 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-513e93cd-a63b-4f07-b9ce-da09e67a996f tempest-VolumesActionsTest-2109691683 None] Created volume successfully. Sep 23 00:33:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Acquiring lock "cinder-4552cac1-9aeb-4526-9d22-949139a4c7e1-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Lock "cinder-4552cac1-9aeb-4526-9d22-949139a4c7e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Acquiring lock "cinder-quobyte-4552cac1-9aeb-4526-9d22-949139a4c7e1" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Lock "cinder-quobyte-4552cac1-9aeb-4526-9d22-949139a4c7e1" acquired by "delete_volume" :: waited 0.015s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:13 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6b17ab-be0b-441d-9114-6c0975738d89]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:13 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 Sep 23 00:33:13 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:13 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1" returned: 0 in 0.426s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1 Sep 23 00:33:14 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4552cac1-9aeb-4526-9d22-949139a4c7e1" returned: 0 in 0.270s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Lock "cinder-quobyte-4552cac1-9aeb-4526-9d22-949139a4c7e1" released by "delete_volume" :: held 0.742s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Created reservations ['29f4872f-d8ec-479f-b083-caffa61f987c', 'ec9d10db-0922-4701-9f85-9c4b8ce82412', 'a365fa53-ef0b-4488-bc8b-70ec28dbe188', '18db7b4a-744f-4af9-a575-5fe50d9b854c', '729886a3-bfd1-4860-955b-1be7f5495ccd'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:14 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:33:14 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:14 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:14 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Deleted volume successfully. Sep 23 00:33:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-62d54816-3110-480c-87c2-aa8df6fc7afc tempest-VolumesActionsTest-1535604417 None] Lock "cinder-4552cac1-9aeb-4526-9d22-949139a4c7e1-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (085106e1-fbd5-4804-9920-b498f017aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac45dd1-d092-4bf1-b159-a7f145196ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ac45dd1-d092-4bf1-b159-a7f145196ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302378791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cfb6de8-103e-45a9-8c0a-dac0378d042a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:15Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c22354c-a3a0-4ee5-a86a-6067db441a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c22354c-a3a0-4ee5-a86a-6067db441a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a986c578-9eac-4b79-b6c8-196b60549ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a986c578-9eac-4b79-b6c8-196b60549ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cfb6de8-103e-45a9-8c0a-dac0378d042a', 'volume_name': 'volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a76178-b0c0-461e-a8cd-a9bb282ff75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a76178-b0c0-461e-a8cd-a9bb282ff75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86284394-a07a-4cfe-9d18-38b11d29c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:15 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Volume 9cfb6de8-103e-45a9-8c0a-dac0378d042a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a', 'volume_size': 1} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302378791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cfb6de8-103e-45a9-8c0a-dac0378d042a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:15Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Creating volume 9cfb6de8-103e-45a9-8c0a-dac0378d042a {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:15 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:15 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a 1073741824 Sep 23 00:33:15 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:15 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a 1073741824" returned: 0 in 0.490s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:15 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a Sep 23 00:33:15 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:16 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86284394-a07a-4cfe-9d18-38b11d29c827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eefa566-27f6-40b3-9137-01d90842214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:16 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Volume volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a (9cfb6de8-103e-45a9-8c0a-dac0378d042a): created successfully Sep 23 00:33:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eefa566-27f6-40b3-9137-01d90842214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (085106e1-fbd5-4804-9920-b498f017aecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:16 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e5e2216e-af75-4ba4-84cf-7442bcc55962 tempest-VolumesActionsTest-2109691683 None] Created volume successfully. Sep 23 00:33:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Acquiring lock "cinder-9cfb6de8-103e-45a9-8c0a-dac0378d042a-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-9cfb6de8-103e-45a9-8c0a-dac0378d042a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Acquiring lock "cinder-quobyte-9cfb6de8-103e-45a9-8c0a-dac0378d042a" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-quobyte-9cfb6de8-103e-45a9-8c0a-dac0378d042a" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:17 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8ec403-f471-4ea7-a697-df1b620c1d33]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:17 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a Sep 23 00:33:17 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:18 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a" returned: 0 in 0.493s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:18 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a Sep 23 00:33:18 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:18 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9cfb6de8-103e-45a9-8c0a-dac0378d042a" returned: 0 in 0.390s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-quobyte-9cfb6de8-103e-45a9-8c0a-dac0378d042a" released by "delete_volume" :: held 0.936s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Created reservations ['5ef63bcc-0649-4065-a1e5-62c584c31787', '9f7a4798-61cc-4007-80b4-bf1f15b43d87', '32b20244-ffab-4dd9-bf67-26abe714920e', 'a1396d6f-4a1f-4e59-bba5-bb93180b14a9', '6794fdb5-3646-4b57-9791-3dbc20133d00'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:18 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:33:18 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:19 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.340s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:19 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:19 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Deleted volume successfully. Sep 23 00:33:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b575ad55-d1d5-48a9-ac83-4205a3e926b4 tempest-VolumesActionsTest-1535604417 None] Lock "cinder-9cfb6de8-103e-45a9-8c0a-dac0378d042a-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (c440994b-c93c-4648-bbb9-0d54730b8777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598ad329-ad27-434e-9cd3-a6433ed60385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (598ad329-ad27-434e-9cd3-a6433ed60385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679416708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac89de8-5c1f-4ec6-878d-909628ab64c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:20Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6e7367-71f2-4fa1-9333-d78c579b2781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6e7367-71f2-4fa1-9333-d78c579b2781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10548f7c-5463-4144-a30f-822378ea2b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10548f7c-5463-4144-a30f-822378ea2b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ac89de8-5c1f-4ec6-878d-909628ab64c0', 'volume_name': 'volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92801352-4209-4592-a18c-e7e75e6da7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92801352-4209-4592-a18c-e7e75e6da7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c771b27-0079-4163-981a-989d960ed0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:20 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Volume 7ac89de8-5c1f-4ec6-878d-909628ab64c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0', 'volume_size': 1} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1679416708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ac89de8-5c1f-4ec6-878d-909628ab64c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8785f98a20b0497a851d3e5e39125b46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:20Z,use_quota=True,user_id='628c556193b8499a829ad4414517ea17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Creating volume 7ac89de8-5c1f-4ec6-878d-909628ab64c0 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:20 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:33:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:20 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 1073741824 Sep 23 00:33:20 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:21 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 1073741824" returned: 0 in 0.588s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:21 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 Sep 23 00:33:21 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:21 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0" returned: 0 in 0.290s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c771b27-0079-4163-981a-989d960ed0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae856a63-1557-4492-88fe-649676ae02f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:21 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Volume volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 (7ac89de8-5c1f-4ec6-878d-909628ab64c0): created successfully Sep 23 00:33:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae856a63-1557-4492-88fe-649676ae02f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:21 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Flow 'volume_create_manager' (c440994b-c93c-4648-bbb9-0d54730b8777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:21 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-62584c89-86fd-4c06-b9e1-27032815ffb3 tempest-VolumesActionsTest-2109691683 None] Created volume successfully. Sep 23 00:33:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Acquiring lock "cinder-7ac89de8-5c1f-4ec6-878d-909628ab64c0-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Lock "cinder-7ac89de8-5c1f-4ec6-878d-909628ab64c0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Acquiring lock "cinder-quobyte-7ac89de8-5c1f-4ec6-878d-909628ab64c0" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Lock "cinder-quobyte-7ac89de8-5c1f-4ec6-878d-909628ab64c0" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:23 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7b01ea-11fa-493e-8a39-5913b7aaf871]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:23 devstack sudo[104839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 Sep 23 00:33:23 devstack sudo[104839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:23 devstack sudo[104839]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0" returned: 0 in 0.468s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:23 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0 Sep 23 00:33:23 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:24 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7ac89de8-5c1f-4ec6-878d-909628ab64c0" returned: 0 in 0.294s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Lock "cinder-quobyte-7ac89de8-5c1f-4ec6-878d-909628ab64c0" released by "delete_volume" :: held 0.809s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Created reservations ['c3ebe44a-bb85-4031-be5c-2d99099426bb', '12e0cf9b-a4dc-486f-ba31-5ee360e464c1', 'c107c211-46ef-4989-a621-0cf1b3c76a3a', '1cb9c245-370e-4543-b884-9d76e28a7723', 'c44db7ff-6c5e-4187-903b-77b963d80b80'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:24 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:33:24 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:24 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.311s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Deleted volume successfully. Sep 23 00:33:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-033eef2c-6f73-45f0-8a6e-bbfe3305521f tempest-VolumesActionsTest-2109691683 None] Lock "cinder-7ac89de8-5c1f-4ec6-878d-909628ab64c0-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:34 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=57,cinder:UPDATE=76,cinder:DELETE=9,cinder:INSERT=16 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:34 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=76,cinder:SELECT=55,cinder:INSERT=22,cinder:DELETE=3 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:44 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:33:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Flow 'volume_create_manager' (2115d46a-fce1-4f5d-92fd-2f3bf0a95a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2a115b-874f-4095-b166-ba528e72cbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2a115b-874f-4095-b166-ba528e72cbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1327091909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce79cb46-95ce-4100-b9c6-5700b5b0a245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b140f95b87224a92aa446183bd8aadb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:45Z,use_quota=True,user_id='60f0b927b6e84453b4b668526f46c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c2f38b-12a7-4836-b0b5-0ca2455d1343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c2f38b-12a7-4836-b0b5-0ca2455d1343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1b7998-a5f4-44f4-b2ec-b7077725c1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1b7998-a5f4-44f4-b2ec-b7077725c1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce79cb46-95ce-4100-b9c6-5700b5b0a245', 'volume_name': 'volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3800c311-abc0-44fe-b69e-d4e1c89bdaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3800c311-abc0-44fe-b69e-d4e1c89bdaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d68a292-5184-44a2-8ff2-321fc315e67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Volume ce79cb46-95ce-4100-b9c6-5700b5b0a245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245', 'volume_size': 1} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1327091909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce79cb46-95ce-4100-b9c6-5700b5b0a245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b140f95b87224a92aa446183bd8aadb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:33:45Z,use_quota=True,user_id='60f0b927b6e84453b4b668526f46c6da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Creating volume ce79cb46-95ce-4100-b9c6-5700b5b0a245 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:33:45 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 1073741824 Sep 23 00:33:45 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 1073741824" returned: 0 in 0.500s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:45 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 Sep 23 00:33:45 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:45 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245" returned: 0 in 0.279s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d68a292-5184-44a2-8ff2-321fc315e67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef20c05-884c-408d-a178-c43f7ccd91e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:33:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Volume volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 (ce79cb46-95ce-4100-b9c6-5700b5b0a245): created successfully Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef20c05-884c-408d-a178-c43f7ccd91e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:33:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Flow 'volume_create_manager' (2115d46a-fce1-4f5d-92fd-2f3bf0a95a2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:33:45 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ce1bbb95-4fb4-40da-96f7-54b0879df72b tempest-AbsoluteLimitsTests-1308723535 None] Created volume successfully. Sep 23 00:33:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Acquiring lock "cinder-ce79cb46-95ce-4100-b9c6-5700b5b0a245-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Lock "cinder-ce79cb46-95ce-4100-b9c6-5700b5b0a245-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Acquiring lock "cinder-quobyte-ce79cb46-95ce-4100-b9c6-5700b5b0a245" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:33:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Lock "cinder-quobyte-ce79cb46-95ce-4100-b9c6-5700b5b0a245" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:33:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a5e790-8148-42de-80a4-d633677aa0d8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:33:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 Sep 23 00:33:47 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:47 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245" returned: 0 in 0.477s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:47 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245 Sep 23 00:33:47 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ce79cb46-95ce-4100-b9c6-5700b5b0a245" returned: 0 in 0.330s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Lock "cinder-quobyte-ce79cb46-95ce-4100-b9c6-5700b5b0a245" released by "delete_volume" :: held 0.862s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Created reservations ['21703e94-177d-4a2b-85d7-2d3590a82922', '796c7c3e-3126-4741-a827-e50c3f442387', 'f5f91149-fbd9-45ad-8043-5c3eb6cd41aa', 'bbafb021-f62b-4ddf-bcba-b86e8095d1e3', '754ab8b1-87ed-4a1b-ad98-cdc292733926'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:33:48 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:33:48 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:33:48 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.282s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:33:48 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Deleted volume successfully. Sep 23 00:33:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-276f8082-75e6-41d7-9bf1-70b37698f6bd tempest-AbsoluteLimitsTests-1308723535 None] Lock "cinder-ce79cb46-95ce-4100-b9c6-5700b5b0a245-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:33:58 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:33:58 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=11,cinder:SELECT=7,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:02 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:34:02 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:03 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.378s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:34:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:34:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:34:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Flow 'volume_create_manager' (051cc588-df8c-491f-b8e8-acf95e17b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdea09c-21f1-4597-b2d8-17a2d872960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cdea09c-21f1-4597-b2d8-17a2d872960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1297593013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aac949-175a-41c6-ac2e-8fa58aaffc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fed7eededc42fb95ac072e583d2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='da3249da2e3f4da99bd8e90206c360ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18be4972-1e96-4949-9a1f-b9eb97a4d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18be4972-1e96-4949-9a1f-b9eb97a4d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ab11d1-9bf1-4ea3-8831-3e0418979cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ab11d1-9bf1-4ea3-8831-3e0418979cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47aac949-175a-41c6-ac2e-8fa58aaffc37', 'volume_name': 'volume-47aac949-175a-41c6-ac2e-8fa58aaffc37', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09318943-12ff-4cf6-87b4-d54f9db06f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09318943-12ff-4cf6-87b4-d54f9db06f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03ea4a5-c245-49f0-b919-c7522c020844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:10 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Volume 47aac949-175a-41c6-ac2e-8fa58aaffc37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47aac949-175a-41c6-ac2e-8fa58aaffc37', 'volume_size': 1} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1297593013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47aac949-175a-41c6-ac2e-8fa58aaffc37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fed7eededc42fb95ac072e583d2c7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:34:10Z,use_quota=True,user_id='da3249da2e3f4da99bd8e90206c360ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Creating volume 47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:34:10 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 1073741824 Sep 23 00:34:10 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 1073741824" returned: 0 in 0.568s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:10 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 Sep 23 00:34:10 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:10 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37" returned: 0 in 0.317s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b03ea4a5-c245-49f0-b919-c7522c020844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47aac949-175a-41c6-ac2e-8fa58aaffc37', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5257b27-61d7-44a3-b475-51ea3ac98ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:34:10 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Volume volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 (47aac949-175a-41c6-ac2e-8fa58aaffc37): created successfully Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5257b27-61d7-44a3-b475-51ea3ac98ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:34:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Flow 'volume_create_manager' (051cc588-df8c-491f-b8e8-acf95e17b840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:34:11 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-abcaf92b-3981-4d48-9618-76ccd0de6319 tempest-VolumesActionsTest-564903512 None] Created volume successfully. Sep 23 00:34:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ecda0a50-7574-45a4-826c-d10aeaab14d6 tempest-VolumesActionsTest-564903512 None] Acquiring lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37" by "attach_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ecda0a50-7574-45a4-826c-d10aeaab14d6 tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37" acquired by "attach_volume" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ecda0a50-7574-45a4-826c-d10aeaab14d6 tempest-VolumesActionsTest-564903512 None] Attaching volume 47aac949-175a-41c6-ac2e-8fa58aaffc37 to instance c9a09a3f-e6de-47a3-9e4e-c9dca2c7b344 at mountpoint /dev/vdb on host None. Sep 23 00:34:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ecda0a50-7574-45a4-826c-d10aeaab14d6 tempest-VolumesActionsTest-564903512 None] Attach volume completed successfully. Sep 23 00:34:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ecda0a50-7574-45a4-826c-d10aeaab14d6 tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37" released by "attach_volume" :: held 0.153s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9eb3eacf-f6e4-4a27-adee-2c47ca948c49 tempest-VolumesActionsTest-564903512 None] Acquiring lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37-detach_volume" by "detach_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9eb3eacf-f6e4-4a27-adee-2c47ca948c49 tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9eb3eacf-f6e4-4a27-adee-2c47ca948c49 tempest-VolumesActionsTest-564903512 None] Detaching volume 47aac949-175a-41c6-ac2e-8fa58aaffc37 from instance c9a09a3f-e6de-47a3-9e4e-c9dca2c7b344. Sep 23 00:34:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9eb3eacf-f6e4-4a27-adee-2c47ca948c49 tempest-VolumesActionsTest-564903512 None] Detach volume completed successfully. Sep 23 00:34:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9eb3eacf-f6e4-4a27-adee-2c47ca948c49 tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:30 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:30 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9d55f994-2d24-4784-a3da-88a4975421bd tempest-VolumesActionsTest-564903512 None] Acquiring lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37" by "attach_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9d55f994-2d24-4784-a3da-88a4975421bd tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37" acquired by "attach_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9d55f994-2d24-4784-a3da-88a4975421bd tempest-VolumesActionsTest-564903512 None] Attaching volume 47aac949-175a-41c6-ac2e-8fa58aaffc37 to instance b99b82be-7118-4554-9dd3-7448319bde1f at mountpoint /dev/vdb on host None. Sep 23 00:34:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-9d55f994-2d24-4784-a3da-88a4975421bd tempest-VolumesActionsTest-564903512 None] Attach volume completed successfully. Sep 23 00:34:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-9d55f994-2d24-4784-a3da-88a4975421bd tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37" released by "attach_volume" :: held 0.105s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-46bfe00a-2441-49e2-880a-0a767fb5cdb7 tempest-VolumesActionsTest-564903512 None] Acquiring lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37-detach_volume" by "detach_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:34:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-46bfe00a-2441-49e2-880a-0a767fb5cdb7 tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:34:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-46bfe00a-2441-49e2-880a-0a767fb5cdb7 tempest-VolumesActionsTest-564903512 None] Detaching volume 47aac949-175a-41c6-ac2e-8fa58aaffc37 from instance b99b82be-7118-4554-9dd3-7448319bde1f. Sep 23 00:34:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-46bfe00a-2441-49e2-880a-0a767fb5cdb7 tempest-VolumesActionsTest-564903512 None] Detach volume completed successfully. Sep 23 00:34:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-46bfe00a-2441-49e2-880a-0a767fb5cdb7 tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:34:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:34:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:34:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[631b2c33-499f-4f43-b098-6bb14d94e9f2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:38 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 Sep 23 00:34:38 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:38 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37" returned: 0 in 0.474s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c638c-4f6c-4b3b-93d6-6fbbfcb9cdef]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:38 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 Sep 23 00:34:38 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:39 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37" returned: 0 in 0.462s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.04ffc827-fe25-4e20-a3b8-aa0d41daa124gaf5ugb_.img {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:39 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.04ffc827-fe25-4e20-a3b8-aa0d41daa124gaf5ugb_.img Sep 23 00:34:39 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:43 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:45 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.04ffc827-fe25-4e20-a3b8-aa0d41daa124gaf5ugb_.img" returned: 0 in 6.501s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:45 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3e6d59-b8e1-47b4-9fb6-4c342e2b3454]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:34:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:34:45 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 Sep 23 00:34:45 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:34:46 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 23 00:34:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37" returned: 0 in 0.633s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:34:46 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.04ffc827-fe25-4e20-a3b8-aa0d41daa124gaf5ugb_.img {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:34:46 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Converted 1024.00 MB image at 157.49 MB/s Sep 23 00:34:46 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] 04ffc827-fe25-4e20-a3b8-aa0d41daa124 was raw, no need to convert to raw {{(pid=87138) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 23 00:34:48 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:INSERT=2,cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:34:56 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=2 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:35:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:02 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:35:02 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:03 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.341s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:35:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:35:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:35:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.468s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Uploaded volume to glance image-id: 04ffc827-fe25-4e20-a3b8-aa0d41daa124. {{(pid=87138) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:35:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-7c493123-06b2-412e-95e6-7ef535f4348b tempest-VolumesActionsTest-564903512 None] Copy volume to image completed successfully. Sep 23 00:35:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[39934bba-9086-4af7-b584-cb0a56efb696]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:08 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 Sep 23 00:35:08 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:09 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37" returned: 0 in 0.425s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:09 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0985ebee-600d-44ea-9951-81641cb3488e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:09 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 Sep 23 00:35:09 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:09 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37" returned: 0 in 0.424s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:09 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img Sep 23 00:35:09 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:16 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img" returned: 0 in 6.584s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:16 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac21a62-f193-46f0-98b9-9b44c81ba08e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:16 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 Sep 23 00:35:16 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:16 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37" returned: 0 in 0.573s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:16 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:35:16 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Converted 1024.00 MB image at 155.51 MB/s Sep 23 00:35:16 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] d5ffcc15-84e8-42ad-ba11-a4402d27dab6 was raw, converting to qcow2 {{(pid=87138) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 23 00:35:16 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c17ee2d-8ebf-454a-9822-83bc90a23896]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:16 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img Sep 23 00:35:16 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:17 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img" returned: 0 in 0.352s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:17 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img Sep 23 00:35:17 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:17 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img" returned: 1 in 0.349s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:35:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img /opt/stack/data/cinder/conversion/vol_upload_ce7d2f8f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:17 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img /opt/stack/data/cinder/conversion/vol_upload_ce7d2f8f Sep 23 00:35:17 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:17 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img /opt/stack/data/cinder/conversion/vol_upload_ce7d2f8f" returned: 0 in 0.295s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:17 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Image conversion details: src /opt/stack/data/cinder/conversion/47aac949-175a-41c6-ac2e-8fa58aaffc37.temp_image.d5ffcc15-84e8-42ad-ba11-a4402d27dab68_8fxq1r.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ce7d2f8f {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:35:17 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 23 00:35:17 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[751b8d34-5828-4ff1-ad9b-00af98c8cecf]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ce7d2f8f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:17 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ce7d2f8f Sep 23 00:35:17 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:18 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ce7d2f8f" returned: 0 in 0.378s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.004s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:19 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Uploaded volume to glance image-id: d5ffcc15-84e8-42ad-ba11-a4402d27dab6. {{(pid=87138) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 23 00:35:19 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bdcc113f-7e97-44f6-a653-1abd4000f71b tempest-VolumesActionsTest-564903512 None] Copy volume to image completed successfully. Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Acquiring lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Acquiring lock "cinder-quobyte-47aac949-175a-41c6-ac2e-8fa58aaffc37" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Lock "cinder-quobyte-47aac949-175a-41c6-ac2e-8fa58aaffc37" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee01ada-ec64-4704-8787-e1d369255e60]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:21 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 Sep 23 00:35:21 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:21 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37" returned: 0 in 0.413s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:21 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37 Sep 23 00:35:21 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:21 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-47aac949-175a-41c6-ac2e-8fa58aaffc37" returned: 0 in 0.284s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Lock "cinder-quobyte-47aac949-175a-41c6-ac2e-8fa58aaffc37" released by "delete_volume" :: held 0.740s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:21 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Created reservations ['79848d9c-a069-4228-8b16-24edf5d48975', '55630506-c454-4e89-98d6-5979b4633185', 'f07e586b-4037-4538-ae9a-e56c7203a61c', '1dba0eb1-bb62-4188-b1aa-6aa98bbdafc2', 'f18edff6-ef3d-4e8f-a9f5-d85e173f5f56'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:35:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:22 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:35:22 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:22 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.290s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:22 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Deleted volume successfully. Sep 23 00:35:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2530c80a-4e8a-4c61-9382-61326853d160 tempest-VolumesActionsTest-564903512 None] Lock "cinder-47aac949-175a-41c6-ac2e-8fa58aaffc37-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (10a61c92-9bfe-4b37-910d-3f9ea7d36ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4eea61-49d0-4bd9-98e5-83f45649d1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4eea61-49d0-4bd9-98e5-83f45649d1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-23078009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d833bbb-bbcd-4bdf-8d34-170f8dc7413d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:32Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c672ea-aa04-4d05-afeb-e7e9201e03a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c672ea-aa04-4d05-afeb-e7e9201e03a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3a3592-d241-4ddb-ba98-197f99fe4a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3a3592-d241-4ddb-ba98-197f99fe4a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d833bbb-bbcd-4bdf-8d34-170f8dc7413d', 'volume_name': 'volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53a0cd5-04f5-4def-9440-c1c22923d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53a0cd5-04f5-4def-9440-c1c22923d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed13b39-d5bf-48a0-b6dc-e7dfdf07fbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:32 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Volume 0d833bbb-bbcd-4bdf-8d34-170f8dc7413d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d', 'volume_size': 1} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-23078009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d833bbb-bbcd-4bdf-8d34-170f8dc7413d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:32Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Creating volume 0d833bbb-bbcd-4bdf-8d34-170f8dc7413d {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:32 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d 1073741824 Sep 23 00:35:32 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:32 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d 1073741824" returned: 0 in 0.559s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:32 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d Sep 23 00:35:32 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:33 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d" returned: 0 in 0.274s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed13b39-d5bf-48a0-b6dc-e7dfdf07fbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8957c1c-9181-4926-989e-65141e919a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:33 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Volume volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d (0d833bbb-bbcd-4bdf-8d34-170f8dc7413d): created successfully Sep 23 00:35:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8957c1c-9181-4926-989e-65141e919a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (10a61c92-9bfe-4b37-910d-3f9ea7d36ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d830772a-2afd-4735-9049-4d0cc60c0b48 tempest-VolumesGetTest-840142932 None] Created volume successfully. Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (f3c1932c-2024-4425-a878-805ec48d8330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427516aa-b36f-4d8e-b50a-43eb418d235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427516aa-b36f-4d8e-b50a-43eb418d235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-455930912',display_name='tempest-VolumesGetTest-Volume-744200979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ced088f-b525-4ce4-8ed0-fe246847f04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:35Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b18d336-930d-4aab-8f5d-ee64914aea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b18d336-930d-4aab-8f5d-ee64914aea17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051793ca-fcde-49fc-9c7f-16e2f377762e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051793ca-fcde-49fc-9c7f-16e2f377762e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ced088f-b525-4ce4-8ed0-fe246847f04f', 'volume_name': 'volume-9ced088f-b525-4ce4-8ed0-fe246847f04f', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c2d908-3347-483f-ab2d-db36603d5ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c2d908-3347-483f-ab2d-db36603d5ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a5430e-6dbb-4f13-ac68-e0425a19f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Volume 9ced088f-b525-4ce4-8ed0-fe246847f04f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ced088f-b525-4ce4-8ed0-fe246847f04f', 'volume_size': 1} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-455930912',display_name='tempest-VolumesGetTest-Volume-744200979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ced088f-b525-4ce4-8ed0-fe246847f04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:35Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Creating volume 9ced088f-b525-4ce4-8ed0-fe246847f04f {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:35 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:35 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f 1073741824 Sep 23 00:35:35 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:35 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f 1073741824" returned: 0 in 0.478s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:35 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f Sep 23 00:35:35 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:35 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f" returned: 0 in 0.299s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a5430e-6dbb-4f13-ac68-e0425a19f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ced088f-b525-4ce4-8ed0-fe246847f04f', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243e1894-ca99-4358-8602-467a3c53a14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Volume volume-9ced088f-b525-4ce4-8ed0-fe246847f04f (9ced088f-b525-4ce4-8ed0-fe246847f04f): created successfully Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243e1894-ca99-4358-8602-467a3c53a14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (f3c1932c-2024-4425-a878-805ec48d8330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c86a5607-148e-40be-8531-7fbf2a4e7892 tempest-VolumesGetTest-840142932 None] Created volume successfully. Sep 23 00:35:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-9ced088f-b525-4ce4-8ed0-fe246847f04f-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Lock "cinder-9ced088f-b525-4ce4-8ed0-fe246847f04f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-quobyte-9ced088f-b525-4ce4-8ed0-fe246847f04f" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-9ced088f-b525-4ce4-8ed0-fe246847f04f" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:37 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b97736-6cba-449f-9c9f-61041d4ffd6e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:37 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f Sep 23 00:35:37 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:37 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f" returned: 0 in 0.474s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:37 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f Sep 23 00:35:37 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:38 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9ced088f-b525-4ce4-8ed0-fe246847f04f" returned: 0 in 0.328s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-9ced088f-b525-4ce4-8ed0-fe246847f04f" released by "delete_volume" :: held 0.854s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Created reservations ['a02ebf8e-7480-4898-add2-614a808222a9', 'ab1788d4-65b9-4e0d-9a7a-b18dbbaad920', '593cf6d1-e546-4827-8493-c6bc57a3af1c', '1d7a8a44-28e7-467b-a5a4-70960723f011', 'a5f00e60-2981-4e6f-a1a5-a2d8e2e10f05'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:38 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:35:38 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Lock "cinder-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-quobyte-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0c0eec-4150-420b-9ccb-bee392eb92aa]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:38 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.348s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:38 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Deleted volume successfully. Sep 23 00:35:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f3ed1fb-4e85-4b27-802d-c45770fab736 tempest-VolumesGetTest-840142932 None] Lock "cinder-9ced088f-b525-4ce4-8ed0-fe246847f04f-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:38 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d Sep 23 00:35:38 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:39 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d" returned: 0 in 0.429s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:39 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d Sep 23 00:35:39 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:39 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d" returned: 0 in 0.290s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d" released by "delete_volume" :: held 0.789s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Created reservations ['eb95bea8-5fa8-4e6a-9b40-532380abb588', 'ccdc1792-e3c8-4b2f-810d-ee58f84c8103', '88432c66-a90c-49ed-9281-f30487095c58', '5343eadd-08f2-4bb1-bc31-8f74700bb272', '94b40d14-cc27-42dd-bca2-ca548c5ecfdc'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:39 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:35:39 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:40 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.372s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:35:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Deleted volume successfully. Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-eb7bea19-41b1-4651-894f-5e640c574185 tempest-VolumesGetTest-840142932 None] Lock "cinder-0d833bbb-bbcd-4bdf-8d34-170f8dc7413d-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (f436fecd-e8a4-4ebf-8c18-deea8ae3298d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d721b8b-4c22-4c8c-aae9-0d3bc2ffc861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d721b8b-4c22-4c8c-aae9-0d3bc2ffc861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2003303932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8066f9f0-5b63-4428-829b-20136811d58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:40Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dd3325-a0dc-4053-89ee-ddebdca67248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73dd3325-a0dc-4053-89ee-ddebdca67248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0970f6d0-2fa5-4a9e-8db4-25ab6d2f083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0970f6d0-2fa5-4a9e-8db4-25ab6d2f083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8066f9f0-5b63-4428-829b-20136811d58a', 'volume_name': 'volume-8066f9f0-5b63-4428-829b-20136811d58a', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f94a9ae-4c94-4436-a5df-1a6e5ddddc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f94a9ae-4c94-4436-a5df-1a6e5ddddc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eda748e-b129-46eb-aa07-d1d9f3159361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:40 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Volume 8066f9f0-5b63-4428-829b-20136811d58a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8066f9f0-5b63-4428-829b-20136811d58a', 'volume_size': 1} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2003303932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8066f9f0-5b63-4428-829b-20136811d58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:40Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Creating volume 8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:35:40 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:35:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:40 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a 1073741824 Sep 23 00:35:40 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:41 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a 1073741824" returned: 0 in 0.506s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:41 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a Sep 23 00:35:41 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:41 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a" returned: 0 in 0.328s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:35:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eda748e-b129-46eb-aa07-d1d9f3159361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8066f9f0-5b63-4428-829b-20136811d58a', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67de5208-b196-4f43-b685-c743ce670fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Volume volume-8066f9f0-5b63-4428-829b-20136811d58a (8066f9f0-5b63-4428-829b-20136811d58a): created successfully Sep 23 00:35:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67de5208-b196-4f43-b685-c743ce670fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (f436fecd-e8a4-4ebf-8c18-deea8ae3298d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:41 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3a01354d-61e3-4959-a6cd-c17c2453a47c tempest-VolumesGetTest-840142932 None] Created volume successfully. Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (f3c163f0-44ad-4291-ba32-3e9783258566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f3a533-8b5e-470d-96f1-53deae6e6f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f3a533-8b5e-470d-96f1-53deae6e6f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1248388816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f451096d-678b-4695-8c8f-ed1167bda564,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=8066f9f0-5b63-4428-829b-20136811d58a,status='creating',terminated_at=None,updated_at=2026-09-22T22:35:43Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354aac7e-6c69-47e8-8b8d-a903fa840c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354aac7e-6c69-47e8-8b8d-a903fa840c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fd0169-5b7f-477a-8e1c-6559ea566c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fd0169-5b7f-477a-8e1c-6559ea566c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f451096d-678b-4695-8c8f-ed1167bda564', 'volume_name': 'volume-f451096d-678b-4695-8c8f-ed1167bda564', 'volume_size': 1, 'source_volid': '8066f9f0-5b63-4428-829b-20136811d58a', 'source_volstatus': 'available'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee8bfd6-be2d-4df2-bbcf-dc1bbdfa052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee8bfd6-be2d-4df2-bbcf-dc1bbdfa052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcc3b2d-04ab-448d-8bb5-ea2fee7badfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:43 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Volume f451096d-678b-4695-8c8f-ed1167bda564: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f451096d-678b-4695-8c8f-ed1167bda564', 'volume_size': 1, 'source_volid': '8066f9f0-5b63-4428-829b-20136811d58a', 'source_volstatus': 'available'} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:43 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Cloning volume 8066f9f0-5b63-4428-829b-20136811d58a to volume f451096d-678b-4695-8c8f-ed1167bda564 Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Creating offline snapshot 68f4995c-0239-4b4a-80d2-43ee9c03d6b8 of volume 8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcca0a60-d27f-4ff7-baae-c776c2cec0ad]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:43 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a Sep 23 00:35:43 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:43 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a" returned: 0 in 0.445s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:43 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 1G Sep 23 00:35:43 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:44 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 1G" returned: 0 in 0.512s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8066f9f0-5b63-4428-829b-20136811d58a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:44 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8066f9f0-5b63-4428-829b-20136811d58a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 Sep 23 00:35:44 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:44 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8066f9f0-5b63-4428-829b-20136811d58a -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8" returned: 0 in 0.359s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:44 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 is being set with open permissions: ugo+rw Sep 23 00:35:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:44 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 Sep 23 00:35:44 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:45 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8" returned: 0 in 0.275s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:45 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.info Sep 23 00:35:45 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:45 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.info" returned: 0 in 0.278s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:45 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.info is being set with open permissions: ugo+rw Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:45 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.info Sep 23 00:35:45 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:45 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.info" returned: 0 in 0.314s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-quobyte-f451096d-678b-4695-8c8f-ed1167bda564" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-f451096d-678b-4695-8c8f-ed1167bda564" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] snapshot: 68f4995c-0239-4b4a-80d2-43ee9c03d6b8, volume: f451096d-678b-4695-8c8f-ed1167bda564, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6702d4ba-6a94-4ef0-b2c0-d2d6303b6a3c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:45 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 Sep 23 00:35:45 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:46 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8" returned: 0 in 0.470s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8066f9f0-5b63-4428-829b-20136811d58a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:46 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b51294b-32ec-4639-b033-d1298083b595]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:46 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a Sep 23 00:35:46 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:46 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a" returned: 0 in 0.427s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:35:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:35:46 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:35:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:46 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 Sep 23 00:35:46 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:53 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564" returned: 0 in 6.647s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:35:53 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Converted 1024.00 MB image at 154.03 MB/s Sep 23 00:35:53 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 is being set with open permissions: ugo+rw Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:53 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 Sep 23 00:35:53 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:53 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564" returned: 0 in 0.333s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-f451096d-678b-4695-8c8f-ed1167bda564" released by "_copy_volume_from_snapshot" :: held 7.960s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-quobyte-68f4995c-0239-4b4a-80d2-43ee9c03d6b8" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-68f4995c-0239-4b4a-80d2-43ee9c03d6b8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Deleting offline snapshot 68f4995c-0239-4b4a-80d2-43ee9c03d6b8 of volume 8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] snapshot_file for this snap is: volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2537aa-d37b-4b71-a24d-4610fa93ee7a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:53 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 Sep 23 00:35:53 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:54 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8" returned: 0 in 0.493s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8066f9f0-5b63-4428-829b-20136811d58a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:35:54 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[21208ad2-0440-482b-ab61-bff4ce61e5df]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:35:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:54 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a Sep 23 00:35:54 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:54 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a" returned: 0 in 0.656s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:54 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 Sep 23 00:35:54 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:55 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=41,cinder:SELECT=32,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:35:55 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8" returned: 0 in 0.418s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:35:55 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8 Sep 23 00:35:55 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:35:55 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Sep 23 00:35:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a.68f4995c-0239-4b4a-80d2-43ee9c03d6b8" returned: 0 in 0.307s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:35:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-68f4995c-0239-4b4a-80d2-43ee9c03d6b8" released by "_delete_snapshot" :: held 1.989s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:35:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.421s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:35:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcc3b2d-04ab-448d-8bb5-ea2fee7badfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f451096d-678b-4695-8c8f-ed1167bda564', 'volume_size': 1, 'source_volid': '8066f9f0-5b63-4428-829b-20136811d58a', 'source_volstatus': 'available'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f7a168-5bbe-430e-956e-794acfdb50fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:35:59 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Volume volume-f451096d-678b-4695-8c8f-ed1167bda564 (f451096d-678b-4695-8c8f-ed1167bda564): created successfully Sep 23 00:35:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19f7a168-5bbe-430e-956e-794acfdb50fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:35:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (f3c163f0-44ad-4291-ba32-3e9783258566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:35:59 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-707bde2c-61e1-40bb-9153-89c4002180fb tempest-VolumesGetTest-840142932 None] Created volume successfully. Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (7cf302a6-f89b-41cd-b7f6-31ce6203a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66d0acc-7478-4333-961a-5037d27e37d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66d0acc-7478-4333-961a-5037d27e37d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-117296931',display_name='tempest-VolumesGetTest-Volume-692980628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736823ab-bc29-4a5b-90f3-fee1761639ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:01Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc95f3b-5295-4b28-9f11-b29b8acc67ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc95f3b-5295-4b28-9f11-b29b8acc67ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e744998-8a9a-472b-8b6e-6418f9c4cff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e744998-8a9a-472b-8b6e-6418f9c4cff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '736823ab-bc29-4a5b-90f3-fee1761639ed', 'volume_name': 'volume-736823ab-bc29-4a5b-90f3-fee1761639ed', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b530b70c-a7fe-4a37-aa35-d4b2f45c4f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b530b70c-a7fe-4a37-aa35-d4b2f45c4f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561019b0-7743-4d50-b1e9-ff40fa37addc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:00 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Volume 736823ab-bc29-4a5b-90f3-fee1761639ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-736823ab-bc29-4a5b-90f3-fee1761639ed', 'volume_size': 1} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-117296931',display_name='tempest-VolumesGetTest-Volume-692980628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=736823ab-bc29-4a5b-90f3-fee1761639ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:01Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Creating volume 736823ab-bc29-4a5b-90f3-fee1761639ed {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:00 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:36:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:00 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed 1073741824 Sep 23 00:36:00 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:01 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed 1073741824" returned: 0 in 0.504s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:01 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed Sep 23 00:36:01 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:01 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed" returned: 0 in 0.258s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (561019b0-7743-4d50-b1e9-ff40fa37addc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-736823ab-bc29-4a5b-90f3-fee1761639ed', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2809eaa1-c9d5-4d9f-b9dd-5ac0ecacf6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:01 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Volume volume-736823ab-bc29-4a5b-90f3-fee1761639ed (736823ab-bc29-4a5b-90f3-fee1761639ed): created successfully Sep 23 00:36:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2809eaa1-c9d5-4d9f-b9dd-5ac0ecacf6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (7cf302a6-f89b-41cd-b7f6-31ce6203a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fc95c792-2ffa-41bc-9a14-5f48c851d59e tempest-VolumesGetTest-840142932 None] Created volume successfully. Sep 23 00:36:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:36:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:02 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:02 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:02 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-736823ab-bc29-4a5b-90f3-fee1761639ed-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:02 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Lock "cinder-736823ab-bc29-4a5b-90f3-fee1761639ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-quobyte-736823ab-bc29-4a5b-90f3-fee1761639ed" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-736823ab-bc29-4a5b-90f3-fee1761639ed" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc000f-1122-4eea-88c4-597416f94a5e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:03 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.315s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:36:03 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed Sep 23 00:36:03 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:03 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed" returned: 0 in 0.431s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:03 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed Sep 23 00:36:03 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:03 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-736823ab-bc29-4a5b-90f3-fee1761639ed" returned: 0 in 0.268s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-736823ab-bc29-4a5b-90f3-fee1761639ed" released by "delete_volume" :: held 0.749s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Created reservations ['c9c83972-3fc5-4bca-9eb2-b02ac267d9e3', '7735e9e4-52f6-4d95-8c2f-083cc0ebace4', 'de4b62f0-7aea-440a-bde0-e78ab5c70424', 'a5b7aa51-0c9e-4d5c-bfa8-78e7c4966383', '0dbf185d-9a07-44a0-ad23-7df13a3add1c'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:03 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:03 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-f451096d-678b-4695-8c8f-ed1167bda564-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Lock "cinder-f451096d-678b-4695-8c8f-ed1167bda564-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:04 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.329s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-quobyte-f451096d-678b-4695-8c8f-ed1167bda564" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:04 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Deleted volume successfully. Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-f451096d-678b-4695-8c8f-ed1167bda564" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-c7eeef57-aabb-4043-b045-d306443f7281 tempest-VolumesGetTest-840142932 None] Lock "cinder-736823ab-bc29-4a5b-90f3-fee1761639ed-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea3c4c-b877-4b5e-a6c9-9c5e7490cd82]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:04 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 Sep 23 00:36:04 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:04 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564" returned: 0 in 0.398s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:04 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564 Sep 23 00:36:04 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:05 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f451096d-678b-4695-8c8f-ed1167bda564" returned: 0 in 0.267s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-f451096d-678b-4695-8c8f-ed1167bda564" released by "delete_volume" :: held 0.720s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Created reservations ['9f5ebc7c-1bcd-4a3e-8c97-559d880ca2f4', '70e75812-28d9-4000-b267-52f85f6311af', '0e65890f-e410-45d7-81ab-a9460ca5d80f', 'e1912099-1097-4ba6-8aaa-144e3b13c775', 'fd259796-4708-41f8-af60-f3ffd6221285'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:05 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:05 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-8066f9f0-5b63-4428-829b-20136811d58a-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Lock "cinder-8066f9f0-5b63-4428-829b-20136811d58a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-quobyte-8066f9f0-5b63-4428-829b-20136811d58a" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-8066f9f0-5b63-4428-829b-20136811d58a" acquired by "delete_volume" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a607c-fa24-4125-bab2-9fd7e4c37dc2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:05 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.344s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:05 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Deleted volume successfully. Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-49d592d8-8aff-4c11-8a16-58d771814e00 tempest-VolumesGetTest-840142932 None] Lock "cinder-f451096d-678b-4695-8c8f-ed1167bda564-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:05 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a Sep 23 00:36:05 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:05 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a" returned: 0 in 0.425s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:06 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a Sep 23 00:36:06 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:06 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-8066f9f0-5b63-4428-829b-20136811d58a" returned: 0 in 0.276s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-8066f9f0-5b63-4428-829b-20136811d58a" released by "delete_volume" :: held 0.769s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Created reservations ['4b2d7ca5-c3a7-4bcc-a7c8-531d7ab8a867', '31095cf5-3c4c-4d8c-b76c-b341bde2ed1e', '96a75d3d-41f8-4d7c-b69a-05b73dd674bd', '6a0b8d44-960e-4cb7-94d3-81a7bc97f434', '7d16a220-f0ad-422d-9966-54339ff145cd'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:06 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:06 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:06 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.272s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Deleted volume successfully. Sep 23 00:36:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-716554a0-abd4-472f-9082-e0caf29a412c tempest-VolumesGetTest-840142932 None] Lock "cinder-8066f9f0-5b63-4428-829b-20136811d58a-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (e62eb3ff-f85d-48e6-a583-2621cbb47e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030e1d86-beb0-408d-9409-5882c578fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (030e1d86-beb0-408d-9409-5882c578fe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1247068154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89787512-f6ed-426e-90c9-ee6fb8688412,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:08Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b0d652-9b1d-442d-b9d0-e7ab0751b352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b0d652-9b1d-442d-b9d0-e7ab0751b352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4b5b29-2e66-45a3-bd7f-5235145a959e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4b5b29-2e66-45a3-bd7f-5235145a959e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89787512-f6ed-426e-90c9-ee6fb8688412', 'volume_name': 'volume-89787512-f6ed-426e-90c9-ee6fb8688412', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768fdc67-4434-4488-b3b4-0daa5546d5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768fdc67-4434-4488-b3b4-0daa5546d5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5bd9ef-b141-4093-bcb9-8f4012437c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:07 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Volume 89787512-f6ed-426e-90c9-ee6fb8688412: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89787512-f6ed-426e-90c9-ee6fb8688412', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 23 00:36:07 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Trying to clone 89787512-f6ed-426e-90c9-ee6fb8688412 from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb at location (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:36:08 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:36:08 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Image download 20.69 MB at 20.69 MB/s Sep 23 00:36:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b33c5c-6967-4098-901b-9c8b38d6d960]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:08 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD Sep 23 00:36:08 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:08 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:08 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb is fetched for user fbc715a1fe7943ccb80690c69867c91a. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:36:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf61ef27-ffa5-4402-8928-386062eda3c4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:08 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD Sep 23 00:36:08 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:09 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1247068154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89787512-f6ed-426e-90c9-ee6fb8688412,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:08Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Creating volume 89787512-f6ed-426e-90c9-ee6fb8688412 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:09 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:09 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 1073741824 Sep 23 00:36:09 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:09 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 1073741824" returned: 0 in 0.492s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:09 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 Sep 23 00:36:09 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:10 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412" returned: 0 in 0.310s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Attempting download of 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume 89787512-f6ed-426e-90c9-ee6fb8688412. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ead545d-b97b-4112-9ca8-8007f8943ee2]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_gekxkhpg {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:10 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_gekxkhpg Sep 23 00:36:10 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:10 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_gekxkhpg" returned: 0 in 0.428s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_gekxkhpg {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:10 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_gekxkhpg Sep 23 00:36:10 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:10 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_gekxkhpg" returned: 1 in 0.365s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_gekxkhpg' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5c24b4-dd53-4e9e-bdd8-83cd99665b07]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:11 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD Sep 23 00:36:11 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:11 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:11 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb was qcow2, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:36:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:11 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 Sep 23 00:36:11 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:13 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412" returned: 0 in 1.952s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb_d64cvyqadevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:36:13 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Converted 112.00 MB image at 57.34 MB/s Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:13 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 1G Sep 23 00:36:13 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:13 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 1G" returned: 0 in 0.342s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Downloaded image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb ((None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}])) to volume 89787512-f6ed-426e-90c9-ee6fb8688412 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Temporary image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb for user fbc715a1fe7943ccb80690c69867c91a is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Marking volume 89787512-f6ed-426e-90c9-ee6fb8688412 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Copying metadata from image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb to 89787512-f6ed-426e-90c9-ee6fb8688412. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Creating volume glance metadata for volume 89787512-f6ed-426e-90c9-ee6fb8688412 backed by image 509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5bd9ef-b141-4093-bcb9-8f4012437c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89787512-f6ed-426e-90c9-ee6fb8688412', 'volume_size': 1, 'image_id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0d0e7b97b4ba4b5ca997a6d56daec62e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb', 'created_at': datetime.datetime(2026, 9, 22, 22, 6, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/509646b0-f5d3-47dd-b1f5-63dd0ebdd8eb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f1c36f-610a-4579-803c-b4453c28f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:13 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Volume volume-89787512-f6ed-426e-90c9-ee6fb8688412 (89787512-f6ed-426e-90c9-ee6fb8688412): created successfully Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f1c36f-610a-4579-803c-b4453c28f78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:13 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (e62eb3ff-f85d-48e6-a583-2621cbb47e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:13 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-73c163de-9613-4192-898a-3f50dda06a67 tempest-VolumesGetTest-840142932 None] Created volume successfully. Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (f1c4e2ec-e489-4204-86d6-0f7cdc135200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b079042f-356f-47bb-8a3b-fbe88a1251be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b079042f-356f-47bb-8a3b-fbe88a1251be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-242254880',display_name='tempest-VolumesGetTest-Volume-104254340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45912428-1c02-4606-b062-d145f07e59e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:15Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faad195-9d5a-4200-9358-71fcc5f7a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faad195-9d5a-4200-9358-71fcc5f7a03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ce34e3-bc21-4105-a24e-887f030b5966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ce34e3-bc21-4105-a24e-887f030b5966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45912428-1c02-4606-b062-d145f07e59e4', 'volume_name': 'volume-45912428-1c02-4606-b062-d145f07e59e4', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab65aef4-8cfd-47dc-bb44-ce0f30ba5fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab65aef4-8cfd-47dc-bb44-ce0f30ba5fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27abe274-2fb8-4b1b-a966-de46f427df88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:14 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Volume 45912428-1c02-4606-b062-d145f07e59e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45912428-1c02-4606-b062-d145f07e59e4', 'volume_size': 1} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-242254880',display_name='tempest-VolumesGetTest-Volume-104254340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45912428-1c02-4606-b062-d145f07e59e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ccf2a48115847e9a6473eec65411712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:15Z,use_quota=True,user_id='fbc715a1fe7943ccb80690c69867c91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Creating volume 45912428-1c02-4606-b062-d145f07e59e4 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:14 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:36:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:15 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4 1073741824 Sep 23 00:36:15 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:15 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4 1073741824" returned: 0 in 0.527s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:15 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4 Sep 23 00:36:15 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:15 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4" returned: 0 in 0.306s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27abe274-2fb8-4b1b-a966-de46f427df88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45912428-1c02-4606-b062-d145f07e59e4', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfdf872-d7d3-4900-a939-63a119cc70b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:15 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Volume volume-45912428-1c02-4606-b062-d145f07e59e4 (45912428-1c02-4606-b062-d145f07e59e4): created successfully Sep 23 00:36:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bfdf872-d7d3-4900-a939-63a119cc70b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Flow 'volume_create_manager' (f1c4e2ec-e489-4204-86d6-0f7cdc135200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:15 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2eec3d56-7a9f-45e8-b640-86d6f3fb2c3b tempest-VolumesGetTest-840142932 None] Created volume successfully. Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-45912428-1c02-4606-b062-d145f07e59e4-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Lock "cinder-45912428-1c02-4606-b062-d145f07e59e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-quobyte-45912428-1c02-4606-b062-d145f07e59e4" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-45912428-1c02-4606-b062-d145f07e59e4" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb9932-6013-441b-b3b3-2aeb2f7c693b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4 Sep 23 00:36:17 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4" returned: 0 in 0.393s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:17 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4 Sep 23 00:36:17 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:17 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-45912428-1c02-4606-b062-d145f07e59e4" returned: 0 in 0.301s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-45912428-1c02-4606-b062-d145f07e59e4" released by "delete_volume" :: held 0.740s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:17 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Created reservations ['507b2685-bed3-4800-8079-93f6c756244d', 'ee03ab96-58b9-45a6-b3b4-dd898a36e522', '69eedc45-f867-46e6-bd0e-6c8ca256f6e5', '1c832341-bca6-4554-9934-9a0da19fe04a', 'ef5965f7-0767-4655-ba0e-63bd8043a3f7'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:18 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-89787512-f6ed-426e-90c9-ee6fb8688412-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Lock "cinder-89787512-f6ed-426e-90c9-ee6fb8688412-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:18 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.350s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:18 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Deleted volume successfully. Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Acquiring lock "cinder-quobyte-89787512-f6ed-426e-90c9-ee6fb8688412" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a742aa91-9a37-4411-892e-dd759a13522e tempest-VolumesGetTest-840142932 None] Lock "cinder-45912428-1c02-4606-b062-d145f07e59e4-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-89787512-f6ed-426e-90c9-ee6fb8688412" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f656a1-8e29-40a3-825f-fb0517de2143]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 Sep 23 00:36:18 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:18 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412" returned: 0 in 0.421s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:18 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412 Sep 23 00:36:18 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89787512-f6ed-426e-90c9-ee6fb8688412" returned: 0 in 0.292s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Lock "cinder-quobyte-89787512-f6ed-426e-90c9-ee6fb8688412" released by "delete_volume" :: held 0.766s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Created reservations ['0ebf8808-8284-42b1-a7e0-db22986290e6', 'a95c1c44-3e65-4d2d-b7b2-5f47d7879436', 'd88dceef-7be6-4fe1-8435-50300a63d58e', '7e6d24f7-93d1-416f-acfe-9d516f23f410', '99a04905-80b9-4013-8ec2-fda4df4e44f4'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:19 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:19 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:19 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.377s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:19 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Deleted volume successfully. Sep 23 00:36:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e47a0d31-1078-4a49-a9a2-b02de3559db4 tempest-VolumesGetTest-840142932 None] Lock "cinder-89787512-f6ed-426e-90c9-ee6fb8688412-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Flow 'volume_create_manager' (c7c3caa1-2ac5-41f5-b57d-3ea78b8049c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3582e8d6-1879-4381-a064-1e0948c4fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3582e8d6-1879-4381-a064-1e0948c4fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-445992231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81513b05-4f35-452e-8dd6-743bea57b730,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ad0d5f231e64ae29d01bb28bb96a01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:24Z,use_quota=True,user_id='42aad81a11314b28ac758de90253ee2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86ef2ab-4c50-4f7f-bf99-9dd318180ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b86ef2ab-4c50-4f7f-bf99-9dd318180ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ded31f1-c147-4bf3-a8e4-9782301f5e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ded31f1-c147-4bf3-a8e4-9782301f5e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81513b05-4f35-452e-8dd6-743bea57b730', 'volume_name': 'volume-81513b05-4f35-452e-8dd6-743bea57b730', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635d34bc-6e5e-4f09-83be-bc19ed649b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635d34bc-6e5e-4f09-83be-bc19ed649b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5840d2a2-84ec-40b3-ab53-6d758019eb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Volume 81513b05-4f35-452e-8dd6-743bea57b730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81513b05-4f35-452e-8dd6-743bea57b730', 'volume_size': 1} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-445992231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81513b05-4f35-452e-8dd6-743bea57b730,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ad0d5f231e64ae29d01bb28bb96a01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:24Z,use_quota=True,user_id='42aad81a11314b28ac758de90253ee2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Creating volume 81513b05-4f35-452e-8dd6-743bea57b730 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:23 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:36:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:23 devstack sudo[105605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730 1073741824 Sep 23 00:36:23 devstack sudo[105605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:24 devstack sudo[105605]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730 1073741824" returned: 0 in 0.465s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:24 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730 Sep 23 00:36:24 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:24 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730" returned: 0 in 0.256s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5840d2a2-84ec-40b3-ab53-6d758019eb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81513b05-4f35-452e-8dd6-743bea57b730', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8b0baa-acc4-45ae-ace8-2dfe7c2253d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Volume volume-81513b05-4f35-452e-8dd6-743bea57b730 (81513b05-4f35-452e-8dd6-743bea57b730): created successfully Sep 23 00:36:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8b0baa-acc4-45ae-ace8-2dfe7c2253d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Flow 'volume_create_manager' (c7c3caa1-2ac5-41f5-b57d-3ea78b8049c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-76a6a8a7-e917-4b20-9abc-d0f7e2403a13 tempest-VolumesListTestJSON-464869485 None] Created volume successfully. Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Flow 'volume_create_manager' (1685412e-2f70-4830-b07d-b4d43df9b8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5dcf9b-b013-4dd4-a036-061e95c9c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5dcf9b-b013-4dd4-a036-061e95c9c046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-299525937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a693c001-3799-4b06-a8d6-c236020787ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ad0d5f231e64ae29d01bb28bb96a01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:25Z,use_quota=True,user_id='42aad81a11314b28ac758de90253ee2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe46fdc-3068-410b-8b63-f9ea897dafa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fe46fdc-3068-410b-8b63-f9ea897dafa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2b33f8-d8e4-4ae3-a760-3532b5181540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2b33f8-d8e4-4ae3-a760-3532b5181540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a693c001-3799-4b06-a8d6-c236020787ca', 'volume_name': 'volume-a693c001-3799-4b06-a8d6-c236020787ca', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612ea9f0-fc4f-4ef9-b896-70681b90af3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612ea9f0-fc4f-4ef9-b896-70681b90af3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73f393f-b80a-4eb1-893d-06465d957dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Volume a693c001-3799-4b06-a8d6-c236020787ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a693c001-3799-4b06-a8d6-c236020787ca', 'volume_size': 1} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-299525937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a693c001-3799-4b06-a8d6-c236020787ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ad0d5f231e64ae29d01bb28bb96a01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:25Z,use_quota=True,user_id='42aad81a11314b28ac758de90253ee2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Creating volume a693c001-3799-4b06-a8d6-c236020787ca {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:25 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:36:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:25 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca 1073741824 Sep 23 00:36:25 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:26 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca 1073741824" returned: 0 in 0.485s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:26 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca Sep 23 00:36:26 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:26 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca" returned: 0 in 0.318s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f73f393f-b80a-4eb1-893d-06465d957dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a693c001-3799-4b06-a8d6-c236020787ca', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26340bf-7eec-47ca-b675-577f6552ed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Volume volume-a693c001-3799-4b06-a8d6-c236020787ca (a693c001-3799-4b06-a8d6-c236020787ca): created successfully Sep 23 00:36:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26340bf-7eec-47ca-b675-577f6552ed6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Flow 'volume_create_manager' (1685412e-2f70-4830-b07d-b4d43df9b8ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ba34d9d9-0d2d-48f6-8fff-287dbbab22ce tempest-VolumesListTestJSON-464869485 None] Created volume successfully. Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Flow 'volume_create_manager' (83a6dfe8-4f7e-447b-863c-7491300961fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5019d9-c354-427d-bba4-4e92dd0b4346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5019d9-c354-427d-bba4-4e92dd0b4346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-142822411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82b53f8-7c87-405d-b2cc-dda533f1abff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ad0d5f231e64ae29d01bb28bb96a01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:28Z,use_quota=True,user_id='42aad81a11314b28ac758de90253ee2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f0683f-3205-4145-a95b-3a92a80bf074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f0683f-3205-4145-a95b-3a92a80bf074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485c6561-7292-4628-a880-c22e3d8bb53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485c6561-7292-4628-a880-c22e3d8bb53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd82b53f8-7c87-405d-b2cc-dda533f1abff', 'volume_name': 'volume-d82b53f8-7c87-405d-b2cc-dda533f1abff', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83121d44-cb47-4b63-8525-18ae83efe124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83121d44-cb47-4b63-8525-18ae83efe124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc36291-17ae-4d6f-b8fc-1d867d2d72bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Volume d82b53f8-7c87-405d-b2cc-dda533f1abff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d82b53f8-7c87-405d-b2cc-dda533f1abff', 'volume_size': 1} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-142822411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82b53f8-7c87-405d-b2cc-dda533f1abff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5ad0d5f231e64ae29d01bb28bb96a01c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:28Z,use_quota=True,user_id='42aad81a11314b28ac758de90253ee2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Creating volume d82b53f8-7c87-405d-b2cc-dda533f1abff {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:28 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:28 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff 1073741824 Sep 23 00:36:28 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:28 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff 1073741824" returned: 0 in 0.475s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:28 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff Sep 23 00:36:28 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:29 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff" returned: 0 in 0.308s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc36291-17ae-4d6f-b8fc-1d867d2d72bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82b53f8-7c87-405d-b2cc-dda533f1abff', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eeebefb-26a3-4573-ba29-b244c94a5de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:29 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Volume volume-d82b53f8-7c87-405d-b2cc-dda533f1abff (d82b53f8-7c87-405d-b2cc-dda533f1abff): created successfully Sep 23 00:36:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eeebefb-26a3-4573-ba29-b244c94a5de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Flow 'volume_create_manager' (83a6dfe8-4f7e-447b-863c-7491300961fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-40bf98dc-048c-49b2-8f8e-159d1a1c60fd tempest-VolumesListTestJSON-464869485 None] Created volume successfully. Sep 23 00:36:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "cinder-d82b53f8-7c87-405d-b2cc-dda533f1abff-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-d82b53f8-7c87-405d-b2cc-dda533f1abff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:32 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=68,cinder:UPDATE=88,cinder:DELETE=11,cinder:INSERT=30 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:36:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "cinder-quobyte-d82b53f8-7c87-405d-b2cc-dda533f1abff" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-quobyte-d82b53f8-7c87-405d-b2cc-dda533f1abff" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:32 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d85853-4322-4ff5-a17a-3deb2917b189]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:32 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff Sep 23 00:36:32 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:32 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff" returned: 0 in 0.431s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff Sep 23 00:36:33 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:33 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d82b53f8-7c87-405d-b2cc-dda533f1abff" returned: 0 in 0.306s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-quobyte-d82b53f8-7c87-405d-b2cc-dda533f1abff" released by "delete_volume" :: held 0.788s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Created reservations ['b428e23d-c754-42e3-98ef-43bc7b9aa5a0', 'e264c817-c3da-45c3-a30b-1ce54093574b', 'ae0f8c07-004b-4baf-829e-db82fdaca662', '6f8496b9-1424-418a-9e55-97aa765c5bcd', 'd93be069-2169-4171-b205-90b2c9a783fb'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:33 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "cinder-a693c001-3799-4b06-a8d6-c236020787ca-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-a693c001-3799-4b06-a8d6-c236020787ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:33 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.330s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Deleted volume successfully. Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "cinder-quobyte-a693c001-3799-4b06-a8d6-c236020787ca" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1abd408f-7dbc-4e4d-9f58-97479361db53 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-d82b53f8-7c87-405d-b2cc-dda533f1abff-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-quobyte-a693c001-3799-4b06-a8d6-c236020787ca" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0337fd3-3e33-47fa-81ae-6657c3e102f3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:33 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca Sep 23 00:36:34 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca" returned: 0 in 0.424s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca Sep 23 00:36:34 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:34 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a693c001-3799-4b06-a8d6-c236020787ca" returned: 0 in 0.295s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-quobyte-a693c001-3799-4b06-a8d6-c236020787ca" released by "delete_volume" :: held 0.764s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Created reservations ['d5829ade-8407-4b25-bd6d-01e1b0a9be80', '832a25f9-57d6-422d-a410-8a05792616a0', '07acbe14-1d91-44e6-8753-7e4d8af5d6d9', '9e7a1d60-9c2b-4784-a0eb-33c30f178455', 'e60d021f-3b3d-4b4a-ae28-9237a76725b6'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:34 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:34 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "cinder-81513b05-4f35-452e-8dd6-743bea57b730-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-81513b05-4f35-452e-8dd6-743bea57b730-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "cinder-quobyte-81513b05-4f35-452e-8dd6-743bea57b730" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-quobyte-81513b05-4f35-452e-8dd6-743bea57b730" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:35 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.369s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b02c495-f98f-4a42-8e14-617fb4ddacd9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Deleted volume successfully. Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d13991c6-a223-47f5-9212-1ebe9b2cee53 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-a693c001-3799-4b06-a8d6-c236020787ca-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:35 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730 Sep 23 00:36:35 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730" returned: 0 in 0.414s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:35 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730 Sep 23 00:36:35 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:35 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-81513b05-4f35-452e-8dd6-743bea57b730" returned: 0 in 0.289s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-quobyte-81513b05-4f35-452e-8dd6-743bea57b730" released by "delete_volume" :: held 0.765s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:35 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Created reservations ['8739dc93-e9e4-441d-bfc8-e753ee93ae2e', 'efd50c7c-910b-4161-aafc-ebe3249d8fbf', 'cd1b73d5-53b6-4207-a63a-3153d93fc8dc', 'fea7b5b2-1964-49ff-b416-5d5740812f5a', 'b44e6afd-d3bb-459b-9ba5-cb8008c1ef6e'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:36 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:36 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:36 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:36 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Deleted volume successfully. Sep 23 00:36:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f734027f-be98-44e2-b082-77d8acefeca9 tempest-VolumesListTestJSON-464869485 None] Lock "cinder-81513b05-4f35-452e-8dd6-743bea57b730-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Flow 'volume_create_manager' (14141e5d-2600-419b-8784-42682a21bbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94db58a-ede4-4b7e-8e7f-076ef79d64ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94db58a-ede4-4b7e-8e7f-076ef79d64ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1303122038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91849682-aa21-49e0-9055-3b03dd5053ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0955f914d840b783756d061a9ed7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:40Z,use_quota=True,user_id='d2237345ba4843d2abfe438ef1ca5a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9206ab2-1b48-4cb3-84ff-3a3d6e339299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9206ab2-1b48-4cb3-84ff-3a3d6e339299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aefdc14-e473-4330-9b4a-4afd84bb2be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aefdc14-e473-4330-9b4a-4afd84bb2be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91849682-aa21-49e0-9055-3b03dd5053ef', 'volume_name': 'volume-91849682-aa21-49e0-9055-3b03dd5053ef', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c45a166-b03d-40ab-a8d8-7705c74a330a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c45a166-b03d-40ab-a8d8-7705c74a330a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8209b2-5374-4e28-8015-0c933dddc228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:39 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Volume 91849682-aa21-49e0-9055-3b03dd5053ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91849682-aa21-49e0-9055-3b03dd5053ef', 'volume_size': 1} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1303122038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91849682-aa21-49e0-9055-3b03dd5053ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0955f914d840b783756d061a9ed7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:40Z,use_quota=True,user_id='d2237345ba4843d2abfe438ef1ca5a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Creating volume 91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:39 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:36:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:39 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef 1073741824 Sep 23 00:36:39 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef 1073741824" returned: 0 in 0.501s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:40 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef Sep 23 00:36:40 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:40 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef" returned: 0 in 0.255s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:36:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8209b2-5374-4e28-8015-0c933dddc228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91849682-aa21-49e0-9055-3b03dd5053ef', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f7388e-cb76-4e29-b19e-7cd842a43613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:40 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Volume volume-91849682-aa21-49e0-9055-3b03dd5053ef (91849682-aa21-49e0-9055-3b03dd5053ef): created successfully Sep 23 00:36:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7f7388e-cb76-4e29-b19e-7cd842a43613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Flow 'volume_create_manager' (14141e5d-2600-419b-8784-42682a21bbfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-084f7ef9-2931-4050-8a00-f54fc88a860b tempest-VolumeDependencyTests-178323496 None] Created volume successfully. Sep 23 00:36:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Creating offline snapshot daf721dd-b2ae-479f-92cc-e47305269408 of volume 91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:36:42 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ee3518-b84a-4647-8b6f-0f68aedd5b5d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:42 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef Sep 23 00:36:42 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:42 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef" returned: 0 in 0.390s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:42 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 1G Sep 23 00:36:42 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:42 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 1G" returned: 0 in 0.457s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91849682-aa21-49e0-9055-3b03dd5053ef -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91849682-aa21-49e0-9055-3b03dd5053ef -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 Sep 23 00:36:43 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91849682-aa21-49e0-9055-3b03dd5053ef -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408" returned: 0 in 0.326s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 is being set with open permissions: ugo+rw Sep 23 00:36:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 Sep 23 00:36:43 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408" returned: 0 in 0.265s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.info Sep 23 00:36:43 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:43 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.info" returned: 0 in 0.258s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:43 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.info is being set with open permissions: ugo+rw Sep 23 00:36:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:43 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.info Sep 23 00:36:43 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:44 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.info" returned: 0 in 0.256s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:44 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8fada9a4-4057-48b7-ab9f-fd0b7de1f178 tempest-VolumeDependencyTests-178323496 None] Create snapshot completed successfully Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Flow 'volume_create_manager' (870d007b-7c15-4cfd-94a4-9f49299e5318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7a4280-3bdb-4275-ac0a-9111f68feea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7a4280-3bdb-4275-ac0a-9111f68feea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1632960928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e626e2f-26ef-48e5-a6d9-432f7a504b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0955f914d840b783756d061a9ed7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=daf721dd-b2ae-479f-92cc-e47305269408,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:36:46Z,use_quota=True,user_id='d2237345ba4843d2abfe438ef1ca5a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a3005e-3913-4bbb-baf7-ad6c7653b0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a3005e-3913-4bbb-baf7-ad6c7653b0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78db4fa-6014-439c-a1f1-c639985462fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c78db4fa-6014-439c-a1f1-c639985462fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e626e2f-26ef-48e5-a6d9-432f7a504b46', 'volume_name': 'volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46', 'volume_size': 1, 'snapshot_id': 'daf721dd-b2ae-479f-92cc-e47305269408'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e628ce-5e4f-40e9-ac77-1ff0d0607caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e628ce-5e4f-40e9-ac77-1ff0d0607caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2fa67d-414d-4cf9-94e5-c6dbc500afcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Volume 0e626e2f-26ef-48e5-a6d9-432f7a504b46: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46', 'volume_size': 1, 'snapshot_id': 'daf721dd-b2ae-479f-92cc-e47305269408'} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "cinder-quobyte-daf721dd-b2ae-479f-92cc-e47305269408-0e626e2f-26ef-48e5-a6d9-432f7a504b46" by "_create_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-daf721dd-b2ae-479f-92cc-e47305269408-0e626e2f-26ef-48e5-a6d9-432f7a504b46" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Creating volume 0e626e2f-26ef-48e5-a6d9-432f7a504b46 from snapshot daf721dd-b2ae-479f-92cc-e47305269408 {{(pid=87138) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "cinder-quobyte-0e626e2f-26ef-48e5-a6d9-432f7a504b46" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-0e626e2f-26ef-48e5-a6d9-432f7a504b46" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] snapshot: daf721dd-b2ae-479f-92cc-e47305269408, volume: 0e626e2f-26ef-48e5-a6d9-432f7a504b46, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3aa349-49ab-4d22-ab55-2ef1a9c6ae99]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 Sep 23 00:36:46 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408" returned: 0 in 0.384s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91849682-aa21-49e0-9055-3b03dd5053ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcd32e0-52c0-4ca7-b60f-d2ae40ec2a31]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef Sep 23 00:36:46 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:46 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef" returned: 0 in 0.373s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:36:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:46 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 Sep 23 00:36:46 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:52 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46" returned: 0 in 6.124s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:52 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:36:52 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Converted 1024.00 MB image at 167.17 MB/s Sep 23 00:36:52 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 is being set with open permissions: ugo+rw Sep 23 00:36:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:52 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 Sep 23 00:36:52 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:53 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46" returned: 0 in 0.258s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-0e626e2f-26ef-48e5-a6d9-432f7a504b46" released by "_copy_volume_from_snapshot" :: held 7.220s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-daf721dd-b2ae-479f-92cc-e47305269408-0e626e2f-26ef-48e5-a6d9-432f7a504b46" released by "_create_volume_from_snapshot" :: held 7.289s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.306s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2fa67d-414d-4cf9-94e5-c6dbc500afcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46', 'volume_size': 1, 'snapshot_id': 'daf721dd-b2ae-479f-92cc-e47305269408'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78f47a8-8406-46d2-8b2d-bf3a8edeedd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:36:53 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Volume volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 (0e626e2f-26ef-48e5-a6d9-432f7a504b46): created successfully Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f78f47a8-8406-46d2-8b2d-bf3a8edeedd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Flow 'volume_create_manager' (870d007b-7c15-4cfd-94a4-9f49299e5318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:36:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f0150d8e-3f24-4a07-acac-ccfc924888c8 tempest-VolumeDependencyTests-178323496 None] Created volume successfully. Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "cinder-daf721dd-b2ae-479f-92cc-e47305269408-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-daf721dd-b2ae-479f-92cc-e47305269408-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "cinder-quobyte-91849682-aa21-49e0-9055-3b03dd5053ef" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-91849682-aa21-49e0-9055-3b03dd5053ef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "cinder-quobyte-daf721dd-b2ae-479f-92cc-e47305269408" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-daf721dd-b2ae-479f-92cc-e47305269408" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Deleting offline snapshot daf721dd-b2ae-479f-92cc-e47305269408 of volume 91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] snapshot_file for this snap is: volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9f74ec-dbc7-41bb-be3f-ae16b5643592]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:53 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 Sep 23 00:36:53 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:54 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408" returned: 0 in 0.390s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91849682-aa21-49e0-9055-3b03dd5053ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:36:54 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d418d4a3-a438-42b0-be0b-0ec3abe48e92]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:54 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef Sep 23 00:36:54 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:54 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef" returned: 0 in 0.589s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:54 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 Sep 23 00:36:54 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:55 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408" returned: 0 in 0.400s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:55 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408 Sep 23 00:36:55 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:55 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef.daf721dd-b2ae-479f-92cc-e47305269408" returned: 0 in 0.290s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=113,cinder:SELECT=77,cinder:DELETE=7,cinder:INSERT=29 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-daf721dd-b2ae-479f-92cc-e47305269408" released by "_delete_snapshot" :: held 1.797s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-91849682-aa21-49e0-9055-3b03dd5053ef" released by "delete_snapshot" :: held 1.829s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Created reservations ['da36eb7b-7e00-4eef-a3b0-7d2ff755a505', '06f6d233-487e-47f7-90a0-f14535576aff', 'b5f95f4f-587a-4a7c-9614-0a27bdc95f62', '9cbeeb2f-e3bd-46f1-b539-902a39334dc3', 'f6a1c72a-4091-49ed-87a9-e797d2ae6d38'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Delete snapshot completed successfully. Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-97fbac54-976b-4962-b1a8-436a8d66c711 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-daf721dd-b2ae-479f-92cc-e47305269408-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "cinder-91849682-aa21-49e0-9055-3b03dd5053ef-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-91849682-aa21-49e0-9055-3b03dd5053ef-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "cinder-quobyte-91849682-aa21-49e0-9055-3b03dd5053ef" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-91849682-aa21-49e0-9055-3b03dd5053ef" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[194fff88-ddd9-45d6-aa67-82846db60234]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef Sep 23 00:36:56 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef" returned: 0 in 0.436s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef Sep 23 00:36:56 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-91849682-aa21-49e0-9055-3b03dd5053ef" returned: 0 in 0.261s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-91849682-aa21-49e0-9055-3b03dd5053ef" released by "delete_volume" :: held 0.768s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Created reservations ['f6ad52e1-f6c9-48cd-9b1c-4ca7c3b2c9c3', '3148c588-0501-47c3-92b5-90a50aaf9a05', 'd3469e08-d094-443c-879a-c60f37b4a331', 'e3cee740-123b-4a1a-acbf-c8d76ce766cd', '4c792efd-27b2-4e41-b195-9db2d1a3e709'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:56 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:56 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Acquiring lock "cinder-0e626e2f-26ef-48e5-a6d9-432f7a504b46-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Lock "cinder-0e626e2f-26ef-48e5-a6d9-432f7a504b46-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Acquiring lock "cinder-quobyte-0e626e2f-26ef-48e5-a6d9-432f7a504b46" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-0e626e2f-26ef-48e5-a6d9-432f7a504b46" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a532fceb-6ad8-4b75-a387-a4b4c08c07e8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:57 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.337s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Deleted volume successfully. Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-570ba1ea-7140-47ae-9c55-9e70d35eecf7 tempest-VolumeDependencyTests-178323496 None] Lock "cinder-91849682-aa21-49e0-9055-3b03dd5053ef-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:57 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 Sep 23 00:36:57 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:57 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46" returned: 0 in 0.435s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:57 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46 Sep 23 00:36:57 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:57 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-0e626e2f-26ef-48e5-a6d9-432f7a504b46" returned: 0 in 0.315s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Lock "cinder-quobyte-0e626e2f-26ef-48e5-a6d9-432f7a504b46" released by "delete_volume" :: held 0.806s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:36:57 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Created reservations ['05d973e1-4c28-4820-a37a-f560e7acbffe', 'f135260c-b720-4235-b0af-a9784fe26d2f', '97a81d79-bfa6-4173-98e3-4af06d5b8a21', '2690f1b3-c6cf-4a5a-86e8-c017738fe478', '0270a5a9-f184-42ce-a950-0bff12330842'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:36:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:36:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:36:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:36:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:36:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:36:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:36:58 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:36:58 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:36:58 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 23 00:36:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.304s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:36:58 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:36:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Deleted volume successfully. Sep 23 00:36:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3c05e7ff-3fda-47db-933c-717c5e75e70c tempest-VolumeDependencyTests-178323496 None] Lock "cinder-0e626e2f-26ef-48e5-a6d9-432f7a504b46-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:37:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:02 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:37:02 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:03 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.266s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:37:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:37:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Flow 'volume_create_manager' (90947640-af79-46ca-9449-ecec0ededab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5c936c-55fe-44d4-9bfc-5ab4171e98ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b5c936c-55fe-44d4-9bfc-5ab4171e98ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2cd696-0d32-4932-92e4-5e12068621c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06a6a0943c948009ee5f356e4b026c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:04Z,use_quota=True,user_id='2ccb352bfacb421ab3f1d3ba329c25ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b9e224-1b2c-498c-a5f1-ca50e7f05684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b9e224-1b2c-498c-a5f1-ca50e7f05684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933cf1fa-ff1e-4152-b100-2b4e3080a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (933cf1fa-ff1e-4152-b100-2b4e3080a445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e2cd696-0d32-4932-92e4-5e12068621c2', 'volume_name': 'volume-4e2cd696-0d32-4932-92e4-5e12068621c2', 'volume_size': 1, 'image_id': '7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4b9bb5d3b37a5f3c9a31ef46e2553f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f06a6a0943c948009ee5f356e4b026c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e8ee2ddf9d6818699828201d62e4b0cd0a9bb3a3037ece0b9738205af792ca109612e8511a88c4bbed055a462d894a1612098940ce8d06d7d3ad5e5844428d9', 'id': '7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'created_at': datetime.datetime(2026, 9, 22, 22, 37, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 37, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3/file', 'properties': {}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a361c9d2-886d-47cb-9646-7e7969780980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a361c9d2-886d-47cb-9646-7e7969780980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc707d17-69f9-4d15-a5b0-413cf23df01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:04 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Volume 4e2cd696-0d32-4932-92e4-5e12068621c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e2cd696-0d32-4932-92e4-5e12068621c2', 'volume_size': 1, 'image_id': '7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4b9bb5d3b37a5f3c9a31ef46e2553f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f06a6a0943c948009ee5f356e4b026c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e8ee2ddf9d6818699828201d62e4b0cd0a9bb3a3037ece0b9738205af792ca109612e8511a88c4bbed055a462d894a1612098940ce8d06d7d3ad5e5844428d9', 'id': '7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'created_at': datetime.datetime(2026, 9, 22, 22, 37, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 37, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3/file', 'properties': {}}, 'image_service': } Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Trying to clone 4e2cd696-0d32-4932-92e4-5e12068621c2 from image 7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:37:04 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8388353b-439d-4bb6-aa09-29550ccd5755]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD Sep 23 00:37:04 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:04 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:04 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD Sep 23 00:37:04 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Temporary image 7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3 is fetched for user 2ccb352bfacb421ab3f1d3ba329c25ab. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9ed53e-2713-45e4-8a39-454a70eae54e]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD Sep 23 00:37:05 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD Sep 23 00:37:05 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:05 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e2cd696-0d32-4932-92e4-5e12068621c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06a6a0943c948009ee5f356e4b026c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:04Z,use_quota=True,user_id='2ccb352bfacb421ab3f1d3ba329c25ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Creating volume 4e2cd696-0d32-4932-92e4-5e12068621c2 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:05 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:37:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:05 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 1073741824 Sep 23 00:37:05 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 1073741824" returned: 0 in 0.443s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 Sep 23 00:37:06 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:06 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2" returned: 0 in 0.292s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:06 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Attempting download of 7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'metadata': {}}])) to volume 4e2cd696-0d32-4932-92e4-5e12068621c2. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:37:06 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[58223561-e0a5-44f3-8a77-4a9cb3ceb44c]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_waxggt47 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:06 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_waxggt47 Sep 23 00:37:06 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_waxggt47" returned: 0 in 0.374s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_waxggt47 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_waxggt47 Sep 23 00:37:07 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_waxggt47" returned: 1 in 0.354s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_waxggt47' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:37:07 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1199c896-7a7d-411e-a33e-a01688d64fc7]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:07 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD Sep 23 00:37:07 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:07 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD Sep 23 00:37:08 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD" returned: 1 in 0.343s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:37:08 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] 7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3 was raw, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:37:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 Sep 23 00:37:08 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:08 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2" returned: 0 in 0.477s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:08 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3_puph_nmvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:37:08 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:37:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:08 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 1G Sep 23 00:37:08 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 1G" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Downloaded image 7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3 ((None, [{'url': 'file:///opt/stack/data/glance/images/7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'metadata': {}}])) to volume 4e2cd696-0d32-4932-92e4-5e12068621c2 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Temporary image 7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3 for user 2ccb352bfacb421ab3f1d3ba329c25ab is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Marking volume 4e2cd696-0d32-4932-92e4-5e12068621c2 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Copying metadata from image 7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3 to 4e2cd696-0d32-4932-92e4-5e12068621c2. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Creating volume glance metadata for volume 4e2cd696-0d32-4932-92e4-5e12068621c2 backed by image 7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3 with: {'image_id': '7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e4b9bb5d3b37a5f3c9a31ef46e2553f5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc707d17-69f9-4d15-a5b0-413cf23df01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e2cd696-0d32-4932-92e4-5e12068621c2', 'volume_size': 1, 'image_id': '7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4b9bb5d3b37a5f3c9a31ef46e2553f5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f06a6a0943c948009ee5f356e4b026c2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5e8ee2ddf9d6818699828201d62e4b0cd0a9bb3a3037ece0b9738205af792ca109612e8511a88c4bbed055a462d894a1612098940ce8d06d7d3ad5e5844428d9', 'id': '7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3', 'created_at': datetime.datetime(2026, 9, 22, 22, 37, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 37, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7cc74d86-3da0-4b6f-ad28-d428d3d7c1d3/file', 'properties': {}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc35c53-5044-4c7f-a23d-2d2e56a99133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:09 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Volume volume-4e2cd696-0d32-4932-92e4-5e12068621c2 (4e2cd696-0d32-4932-92e4-5e12068621c2): created successfully Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc35c53-5044-4c7f-a23d-2d2e56a99133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Flow 'volume_create_manager' (90947640-af79-46ca-9449-ecec0ededab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3343856e-adfb-4b5f-9945-958a18536de0 tempest-VolumeImageDependencyTests-794478994 None] Created volume successfully. Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Acquiring lock "cinder-4e2cd696-0d32-4932-92e4-5e12068621c2-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Lock "cinder-4e2cd696-0d32-4932-92e4-5e12068621c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Acquiring lock "cinder-quobyte-4e2cd696-0d32-4932-92e4-5e12068621c2" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Lock "cinder-quobyte-4e2cd696-0d32-4932-92e4-5e12068621c2" acquired by "delete_volume" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[009ac5e3-b2b6-4ea5-83ca-361430bd696a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:09 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 Sep 23 00:37:09 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:09 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2" returned: 0 in 0.399s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:09 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2 Sep 23 00:37:09 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4e2cd696-0d32-4932-92e4-5e12068621c2" returned: 0 in 0.286s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Lock "cinder-quobyte-4e2cd696-0d32-4932-92e4-5e12068621c2" released by "delete_volume" :: held 0.733s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Created reservations ['c55ad372-f8b2-434a-a493-c583b08fbd15', 'ef893b99-f83c-4302-b60f-42bccadbcc3e', '3e685afc-2a78-467f-9c9a-ece6ad3f1a6a', 'b689d989-96f5-46da-b099-e42bc73cfcd9', 'd606545b-9290-49b6-81da-90a0090bb38d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:10 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:37:10 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:10 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.300s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Deleted volume successfully. Sep 23 00:37:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-fa3ec9a3-05a2-49e1-a1f3-5b27238a6040 tempest-VolumeImageDependencyTests-794478994 None] Lock "cinder-4e2cd696-0d32-4932-92e4-5e12068621c2-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=28,cinder:INSERT=17,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:37:20 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=65,cinder:INSERT=23,cinder:UPDATE=69,cinder:DELETE=4 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Flow 'volume_create_manager' (6025412a-ed80-4684-89ea-bd9a402c47c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55eca212-fc77-45c0-adbb-adedea245672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55eca212-fc77-45c0-adbb-adedea245672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-767895056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4e9516b48e420faacc03b6b52eb56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:42Z,use_quota=True,user_id='f36892de8c3f460b9f1f8a860429b967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5c040f-8a43-4e7d-8533-5cc7d5d2bd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e5c040f-8a43-4e7d-8533-5cc7d5d2bd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcc0195-63a9-492a-97b0-9cd154fa0ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcc0195-63a9-492a-97b0-9cd154fa0ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5', 'volume_name': 'volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce280f39-cd18-4f11-8a66-5433d57cc5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce280f39-cd18-4f11-8a66-5433d57cc5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecbafe0-731a-410a-a6d6-7a65001e03f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Volume 2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5', 'volume_size': 1} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-767895056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4e9516b48e420faacc03b6b52eb56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:42Z,use_quota=True,user_id='f36892de8c3f460b9f1f8a860429b967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Creating volume 2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:41 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:37:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:41 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 1073741824 Sep 23 00:37:41 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:42 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 1073741824" returned: 0 in 0.492s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:42 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 Sep 23 00:37:42 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:42 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" returned: 0 in 0.264s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:42 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:37:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fecbafe0-731a-410a-a6d6-7a65001e03f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c0c902-f5da-443d-8cf2-20d630fd1055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:42 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Volume volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 (2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5): created successfully Sep 23 00:37:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c0c902-f5da-443d-8cf2-20d630fd1055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Flow 'volume_create_manager' (6025412a-ed80-4684-89ea-bd9a402c47c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:42 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1f2b6192-37bd-4e7b-aa19-ef2f6b3654b2 tempest-SnapshotDependencyTests-720745695 None] Created volume successfully. Sep 23 00:37:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Creating offline snapshot 7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 of volume 2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:37:44 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b21d4f-2831-4819-841d-0ceaa23d8c5b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 Sep 23 00:37:44 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" returned: 0 in 0.411s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 1G Sep 23 00:37:44 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:44 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 1G" returned: 0 in 0.436s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:44 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 Sep 23 00:37:44 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:45 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3" returned: 0 in 0.322s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:45 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 is being set with open permissions: ugo+rw Sep 23 00:37:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:45 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 Sep 23 00:37:45 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:45 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3" returned: 0 in 0.295s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:45 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.info Sep 23 00:37:45 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:45 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.info" returned: 0 in 0.301s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:45 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.info is being set with open permissions: ugo+rw Sep 23 00:37:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:45 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.info Sep 23 00:37:45 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:46 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.info" returned: 0 in 0.275s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5d7fcfb7-7370-42cc-af0c-065e1eee0334 tempest-SnapshotDependencyTests-720745695 None] Create snapshot completed successfully Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Flow 'volume_create_manager' (22a4e72c-6331-47b0-be7d-fd2aa7744b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783ed505-325e-4e17-8ea2-1b319d25382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (783ed505-325e-4e17-8ea2-1b319d25382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6bf887c-d7f7-4ff4-9056-c9c78ea656b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4e9516b48e420faacc03b6b52eb56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:37:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7dcd7fee-0911-43e3-b7a8-a62a0368f7b3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:37:48Z,use_quota=True,user_id='f36892de8c3f460b9f1f8a860429b967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375430bb-8b2d-492d-a3ec-2672446f196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375430bb-8b2d-492d-a3ec-2672446f196e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cd52f9-ad61-40e7-b72e-664612b873f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94cd52f9-ad61-40e7-b72e-664612b873f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b6bf887c-d7f7-4ff4-9056-c9c78ea656b0', 'volume_name': 'volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0', 'volume_size': 1, 'snapshot_id': '7dcd7fee-0911-43e3-b7a8-a62a0368f7b3'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52b602d-a517-48fb-938a-f0b9a957cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f52b602d-a517-48fb-938a-f0b9a957cb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264c42ed-a074-4d59-89c6-c477f4f5d744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:47 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Volume b6bf887c-d7f7-4ff4-9056-c9c78ea656b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0', 'volume_size': 1, 'snapshot_id': '7dcd7fee-0911-43e3-b7a8-a62a0368f7b3'} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "cinder-quobyte-7dcd7fee-0911-43e3-b7a8-a62a0368f7b3-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" by "_create_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-7dcd7fee-0911-43e3-b7a8-a62a0368f7b3-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Creating volume b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 from snapshot 7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 {{(pid=87138) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "cinder-quobyte-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] snapshot: 7dcd7fee-0911-43e3-b7a8-a62a0368f7b3, volume: b6bf887c-d7f7-4ff4-9056-c9c78ea656b0, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd7533a-f4d1-4f8a-bcfa-3a4006ac8d8a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 Sep 23 00:37:48 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3" returned: 0 in 0.405s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:48 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e225238e-f1ff-460e-8b07-045eb152bbd2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 Sep 23 00:37:48 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:48 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" returned: 0 in 0.377s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:37:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:37:48 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:37:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:48 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 Sep 23 00:37:48 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:55 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" returned: 0 in 6.215s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:37:55 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Converted 1024.00 MB image at 164.74 MB/s Sep 23 00:37:55 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 is being set with open permissions: ugo+rw Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:55 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 Sep 23 00:37:55 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:55 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" returned: 0 in 0.258s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" released by "_copy_volume_from_snapshot" :: held 7.341s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-7dcd7fee-0911-43e3-b7a8-a62a0368f7b3-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" released by "_create_volume_from_snapshot" :: held 7.417s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.433s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264c42ed-a074-4d59-89c6-c477f4f5d744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0', 'volume_size': 1, 'snapshot_id': '7dcd7fee-0911-43e3-b7a8-a62a0368f7b3'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9399e28-997b-48f2-beb5-d40ceebc39db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:37:55 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Volume volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 (b6bf887c-d7f7-4ff4-9056-c9c78ea656b0): created successfully Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9399e28-997b-48f2-beb5-d40ceebc39db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:37:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Flow 'volume_create_manager' (22a4e72c-6331-47b0-be7d-fd2aa7744b6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:37:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1e3cc75e-dbb5-449d-900f-9abfdf581852 tempest-SnapshotDependencyTests-720745695 None] Created volume successfully. Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "cinder-7dcd7fee-0911-43e3-b7a8-a62a0368f7b3-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-7dcd7fee-0911-43e3-b7a8-a62a0368f7b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "cinder-quobyte-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "cinder-quobyte-7dcd7fee-0911-43e3-b7a8-a62a0368f7b3" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-7dcd7fee-0911-43e3-b7a8-a62a0368f7b3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Deleting offline snapshot 7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 of volume 2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] snapshot_file for this snap is: volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecef5aa-6f58-457e-8578-77bf167c8b7a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:56 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 Sep 23 00:37:56 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:56 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3" returned: 0 in 0.393s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:37:57 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b489656-d0a7-4be7-b6e4-b30701d1a7a3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:57 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 Sep 23 00:37:57 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:57 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" returned: 0 in 0.577s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:57 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 Sep 23 00:37:57 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:57 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3" returned: 0 in 0.345s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:57 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3 Sep 23 00:37:57 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:58 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5.7dcd7fee-0911-43e3-b7a8-a62a0368f7b3" returned: 0 in 0.260s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-7dcd7fee-0911-43e3-b7a8-a62a0368f7b3" released by "_delete_snapshot" :: held 1.685s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" released by "delete_snapshot" :: held 1.707s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Created reservations ['0e173b7f-107e-4aa9-8b0f-b266911d2342', '345f2102-b6b2-4a31-8a8f-5208538133d8', '1b260e59-9b6a-4385-94eb-3f3fafc934a4', 'bcb87ab1-be09-46eb-aeec-84c06c2c373e', 'd99230c0-72f8-4a52-a6cd-047bbd6ce7d0'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Delete snapshot completed successfully. Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e45b444f-0e81-4d59-8c24-7214f073d2b5 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-7dcd7fee-0911-43e3-b7a8-a62a0368f7b3-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "cinder-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "cinder-quobyte-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[2285abbc-6cbe-48f7-b21b-a7e3862b432c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:58 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 Sep 23 00:37:58 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:59 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" returned: 0 in 0.372s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:59 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5 Sep 23 00:37:59 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:59 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" returned: 0 in 0.261s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5" released by "delete_volume" :: held 0.695s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Created reservations ['c3bd13cb-617a-450e-b15d-76cdb70e2198', 'a305511a-0d92-4892-8add-5f81e2a1b2b3', '94f34fef-2977-4a37-afaf-3b0925b5cb64', '0d036333-b882-4e22-885d-d1dcc8d356ad', 'dd1723bf-5cb3-421f-b3ad-907a93e49f37'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:37:59 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:37:59 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:37:59 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "cinder-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.289s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:37:59 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Deleted volume successfully. Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-89ed82f1-360b-4c6e-9455-2f40d2058fb7 tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-2e9a80ed-0702-4d15-9f7d-16d0f6faf2e5-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "cinder-quobyte-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" acquired by "delete_volume" :: waited 0.015s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4a5d06-4d62-4ac6-8574-409c7b97dcc1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:37:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:00 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 Sep 23 00:38:00 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:00 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" returned: 0 in 0.395s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:00 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0 Sep 23 00:38:00 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:00 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" returned: 0 in 0.252s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-quobyte-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0" released by "delete_volume" :: held 0.688s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Created reservations ['b208db29-1f07-43b1-b6bc-42b1e3420d56', '71848845-5bb7-42bb-a94e-aa4eb56190e1', '630584e4-5890-4ac7-8604-c7507e6ced10', '7b1eeef1-781b-442b-8512-3925c8ae2cde', 'c1001a32-4032-4509-8259-d3351d13c95f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:00 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:00 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:01 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.317s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:01 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Deleted volume successfully. Sep 23 00:38:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f95a78af-a677-4ab8-81b1-46aa0341b58c tempest-SnapshotDependencyTests-720745695 None] Lock "cinder-b6bf887c-d7f7-4ff4-9056-c9c78ea656b0-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:38:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:02 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:02 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:03 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.312s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:38:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:38:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:38:10 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=29,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:38:11 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=34,cinder:SELECT=26,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (69a822ff-1145-4588-9c69-fcebdd5af760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66458716-3e99-4211-bd5d-bb2d12e96209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66458716-3e99-4211-bd5d-bb2d12e96209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458862944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499ea6b1-7264-46e0-9447-2f72e65caa4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:23Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46f011a-40a5-443a-b9e1-3bea7598dd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46f011a-40a5-443a-b9e1-3bea7598dd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5c0951-8b69-4ed0-b128-5e63666ac713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5c0951-8b69-4ed0-b128-5e63666ac713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '499ea6b1-7264-46e0-9447-2f72e65caa4e', 'volume_name': 'volume-499ea6b1-7264-46e0-9447-2f72e65caa4e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ff180d-2d43-4608-8036-ecd86d3666f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ff180d-2d43-4608-8036-ecd86d3666f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34c53e6-eac0-499f-8c43-f3a260d9d6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume 499ea6b1-7264-46e0-9447-2f72e65caa4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-499ea6b1-7264-46e0-9447-2f72e65caa4e', 'volume_size': 1} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-458862944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=499ea6b1-7264-46e0-9447-2f72e65caa4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:23Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Creating volume 499ea6b1-7264-46e0-9447-2f72e65caa4e {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:23 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:23 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e 1073741824 Sep 23 00:38:23 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Flow 'volume_create_manager' (31e4c958-e2ae-4937-b507-6b628acda5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7de562d-9f46-4599-a322-5103d04fb918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7de562d-9f46-4599-a322-5103d04fb918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-239024737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e238fda1-1b66-4748-9e1a-2e9d9ad0b516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ac9ba19c64f7fae68782541e8e33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:23Z,use_quota=True,user_id='be1008d2b41d4a508329128d81f740f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8be135e-ae3a-4487-95f7-3f3ee0da7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8be135e-ae3a-4487-95f7-3f3ee0da7267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d537b6-5948-40cf-b2b0-d2c9d1d37e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d537b6-5948-40cf-b2b0-d2c9d1d37e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e238fda1-1b66-4748-9e1a-2e9d9ad0b516', 'volume_name': 'volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b609063a-3809-48a4-b04a-3ac4833a69c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b609063a-3809-48a4-b04a-3ac4833a69c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad47b44-fda6-450f-bb7a-d2aa8c08e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Volume e238fda1-1b66-4748-9e1a-2e9d9ad0b516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516', 'volume_size': 1} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:23 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (c7bb27e1-367f-4c89-b47a-6d08b8c013f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4b7597-63ba-4745-9d9c-03bd301ee2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e 1073741824" returned: 0 in 0.608s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4b7597-63ba-4745-9d9c-03bd301ee2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-638500051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57a82bd-e917-4612-8df1-f8cd4abac2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:24Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d3688b-0a02-4734-a9e5-db94a8cc0470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7d3688b-0a02-4734-a9e5-db94a8cc0470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc95a10-6f58-4ff5-a776-ae907281b9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc95a10-6f58-4ff5-a776-ae907281b9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd57a82bd-e917-4612-8df1-f8cd4abac2fd', 'volume_name': 'volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39741c15-da52-47b1-981a-b285d5fbe38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39741c15-da52-47b1-981a-b285d5fbe38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffe123f-6c2f-4bb6-9b11-f1d46ac6f5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:23 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Volume d57a82bd-e917-4612-8df1-f8cd4abac2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd', 'volume_size': 1} Sep 23 00:38:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:24 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e Sep 23 00:38:24 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:24 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e" returned: 0 in 0.313s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-239024737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e238fda1-1b66-4748-9e1a-2e9d9ad0b516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ac9ba19c64f7fae68782541e8e33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:23Z,use_quota=True,user_id='be1008d2b41d4a508329128d81f740f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Creating volume e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:24 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:24 devstack sudo[106095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 1073741824 Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34c53e6-eac0-499f-8c43-f3a260d9d6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-499ea6b1-7264-46e0-9447-2f72e65caa4e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack sudo[106095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e61d3a-8d14-4bdb-8cbf-24784fd0f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume volume-499ea6b1-7264-46e0-9447-2f72e65caa4e (499ea6b1-7264-46e0-9447-2f72e65caa4e): created successfully Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e61d3a-8d14-4bdb-8cbf-24784fd0f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (69a822ff-1145-4588-9c69-fcebdd5af760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (a704ba57-8916-40f6-b559-08acb6c391f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9be446-8a2a-42c1-acc6-a6bb5ea9f574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-63fc9984-2c08-4d60-a5cf-a98088ab43c8 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created volume successfully. Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9be446-8a2a-42c1-acc6-a6bb5ea9f574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2464105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3debbd4-b2eb-40bc-9d99-98eb93b7f630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:24Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2607907e-c45c-4505-8d03-b0e2259e6c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2607907e-c45c-4505-8d03-b0e2259e6c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e125690-077f-4c2f-87c6-ccf38f614aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e125690-077f-4c2f-87c6-ccf38f614aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3debbd4-b2eb-40bc-9d99-98eb93b7f630', 'volume_name': 'volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea3b903-b32e-4852-97d2-a2d45629d7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea3b903-b32e-4852-97d2-a2d45629d7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6315dc6c-b5ea-4eaf-9768-81b26acd5fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Volume b3debbd4-b2eb-40bc-9d99-98eb93b7f630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630', 'volume_size': 1} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (4e95e420-b124-4e22-8f87-927f52883a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a1151b-23e5-4f07-ade7-e860295b8738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a1151b-23e5-4f07-ade7-e860295b8738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1637052143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2b303f-daad-4f3f-a859-8d687e03f921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:25Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720883de-1917-4a57-96ea-4e018a1f4479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (720883de-1917-4a57-96ea-4e018a1f4479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9a4659-6418-4f4a-9d65-56d45b29b545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9a4659-6418-4f4a-9d65-56d45b29b545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee2b303f-daad-4f3f-a859-8d687e03f921', 'volume_name': 'volume-ee2b303f-daad-4f3f-a859-8d687e03f921', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e22783-c036-4057-8914-2db36d13bce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80e22783-c036-4057-8914-2db36d13bce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b6b594-81ca-460f-a330-9cd5746c1c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Volume ee2b303f-daad-4f3f-a859-8d687e03f921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee2b303f-daad-4f3f-a859-8d687e03f921', 'volume_size': 1} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:25 devstack sudo[106095]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 1073741824" returned: 0 in 0.683s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:25 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 Sep 23 00:38:25 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:25 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (ed770a1c-8a22-406c-94a2-e2c7739fc592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b3a67b-7764-467a-af51-614da893b1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" returned: 0 in 0.487s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-638500051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d57a82bd-e917-4612-8df1-f8cd4abac2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:24Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Creating volume d57a82bd-e917-4612-8df1-f8cd4abac2fd {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:25 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05b3a67b-7764-467a-af51-614da893b1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645127190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d5fdce-d92c-42b3-a398-cdb11a849d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:25Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:25 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd 1073741824 Sep 23 00:38:25 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d060b82d-9d85-42d6-84c3-bf84c045f905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d060b82d-9d85-42d6-84c3-bf84c045f905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e97b03-a681-4647-b0d5-56ea3409ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e97b03-a681-4647-b0d5-56ea3409ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d5fdce-d92c-42b3-a398-cdb11a849d11', 'volume_name': 'volume-11d5fdce-d92c-42b3-a398-cdb11a849d11', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7306bde-b922-466a-8db1-87c394e7098b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7306bde-b922-466a-8db1-87c394e7098b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a5ec87-9ffd-423d-a734-3a9100f0c46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Volume 11d5fdce-d92c-42b3-a398-cdb11a849d11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d5fdce-d92c-42b3-a398-cdb11a849d11', 'volume_size': 1} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad47b44-fda6-450f-bb7a-d2aa8c08e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c03576b-7e1d-46da-b911-438a9d7352d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:25 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Volume volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 (e238fda1-1b66-4748-9e1a-2e9d9ad0b516): created successfully Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c03576b-7e1d-46da-b911-438a9d7352d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:25 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Flow 'volume_create_manager' (31e4c958-e2ae-4937-b507-6b628acda5c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f23ba8ac-1193-4673-af1c-31f816f31096 tempest-VolumeDependencyTests-1755904105 None] Created volume successfully. Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:26 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (2acc6ccf-f815-4dce-a9c5-04f421681357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc727109-75df-46fc-b649-8082931cb6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd 1073741824" returned: 0 in 0.680s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc727109-75df-46fc-b649-8082931cb6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1731620818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260f9a8d-c154-4052-99b1-1129f3a8837e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:26Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5a92f2-9ea3-4d48-9ba0-bdb58680fd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5a92f2-9ea3-4d48-9ba0-bdb58680fd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17906ebd-c8b9-4998-a437-137acae1078b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17906ebd-c8b9-4998-a437-137acae1078b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260f9a8d-c154-4052-99b1-1129f3a8837e', 'volume_name': 'volume-260f9a8d-c154-4052-99b1-1129f3a8837e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390dbfcc-c121-4879-9ab7-b1d30ef4ea7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390dbfcc-c121-4879-9ab7-b1d30ef4ea7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d386a418-9bae-4dc6-a69e-c406b0692457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Volume 260f9a8d-c154-4052-99b1-1129f3a8837e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260f9a8d-c154-4052-99b1-1129f3a8837e', 'volume_size': 1} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:26 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd Sep 23 00:38:26 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (3d7444cc-3dce-4e37-afbb-c9a2c677dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38255c5-e52a-418a-a687-f85158ae57a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a38255c5-e52a-418a-a687-f85158ae57a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502493000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7308e9-3d53-4b43-9e54-7b31401176df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:26Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364fa58c-b79c-41ca-b34b-d258ae0c2fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364fa58c-b79c-41ca-b34b-d258ae0c2fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c051599-2b00-4244-877d-040ab3fc2f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c051599-2b00-4244-877d-040ab3fc2f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f7308e9-3d53-4b43-9e54-7b31401176df', 'volume_name': 'volume-2f7308e9-3d53-4b43-9e54-7b31401176df', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8777b5-ebfa-4d9a-8f45-12c86abc6cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8777b5-ebfa-4d9a-8f45-12c86abc6cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec1b214-efbc-4728-98fb-43eb1d142d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume 2f7308e9-3d53-4b43-9e54-7b31401176df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f7308e9-3d53-4b43-9e54-7b31401176df', 'volume_size': 1} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:26 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (cd9136ce-1a64-4262-9c48-7c219954c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4098c4-daa1-4f93-b578-b26278e497db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd" returned: 0 in 0.540s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.401s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2464105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3debbd4-b2eb-40bc-9d99-98eb93b7f630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:24Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Creating volume b3debbd4-b2eb-40bc-9d99-98eb93b7f630 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:26 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:27 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4098c4-daa1-4f93-b578-b26278e497db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118168351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43c6519-77d5-4876-b195-572b2472cb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:27Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 1073741824 Sep 23 00:38:27 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94622dc-4ab9-45ed-b748-e466743581d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94622dc-4ab9-45ed-b748-e466743581d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28874f65-75f6-4b23-88b7-e70dcef62967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28874f65-75f6-4b23-88b7-e70dcef62967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f43c6519-77d5-4876-b195-572b2472cb27', 'volume_name': 'volume-f43c6519-77d5-4876-b195-572b2472cb27', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b8b9df-69bf-4841-a57f-58c396cab672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b8b9df-69bf-4841-a57f-58c396cab672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe04e16d-8fa2-4df8-bc67-5df13146bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume f43c6519-77d5-4876-b195-572b2472cb27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f43c6519-77d5-4876-b195-572b2472cb27', 'volume_size': 1} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fffe123f-6c2f-4bb6-9b11-f1d46ac6f5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfac786-345a-434d-b9c3-f23d658164c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Volume volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd (d57a82bd-e917-4612-8df1-f8cd4abac2fd): created successfully Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfac786-345a-434d-b9c3-f23d658164c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (c7bb27e1-367f-4c89-b47a-6d08b8c013f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (45a6c78a-c21c-4012-a9a6-b6f50b3b79f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5220b98d-92a0-40a6-928d-8a99679b2c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b1edad01-e50e-4f16-a7b1-cc790b34b835 tempest-CreateVolumesFromImageTest-519855524 None] Created volume successfully. Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5220b98d-92a0-40a6-928d-8a99679b2c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-195853806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89187670-b3f2-452c-a1e7-df9febbc9b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:27Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752f0cba-a5a1-4cab-be67-c690af22a637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752f0cba-a5a1-4cab-be67-c690af22a637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e342911-416b-4a75-b707-1fc83d0b3252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e342911-416b-4a75-b707-1fc83d0b3252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89187670-b3f2-452c-a1e7-df9febbc9b5a', 'volume_name': 'volume-89187670-b3f2-452c-a1e7-df9febbc9b5a', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48f14d6-5615-413d-9d3e-d62af086d608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48f14d6-5615-413d-9d3e-d62af086d608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5362c226-7e60-4b6e-af34-4f1e9d7d09b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume 89187670-b3f2-452c-a1e7-df9febbc9b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89187670-b3f2-452c-a1e7-df9febbc9b5a', 'volume_size': 1} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:27 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 1073741824" returned: 0 in 0.639s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:27 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 Sep 23 00:38:27 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (f2cb05c5-5c94-4071-b3e5-2e27b6f3e85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e386aed-fb2a-4c59-b8be-33b168817ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e386aed-fb2a-4c59-b8be-33b168817ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603155114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35a0dd6-c9ed-4313-97bc-39c8286c4f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:28Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6169ce5-aa24-4240-a340-2a741fe4f556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6169ce5-aa24-4240-a340-2a741fe4f556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c28b8b-bbce-44fa-b7d2-f40e4ddf8374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c28b8b-bbce-44fa-b7d2-f40e4ddf8374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35a0dd6-c9ed-4313-97bc-39c8286c4f44', 'volume_name': 'volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daa4271-4a1a-40f9-8100-35cc23a4e915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1daa4271-4a1a-40f9-8100-35cc23a4e915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793d8ea1-1f7a-4809-a3b2-2a64aaa03c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:27 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume a35a0dd6-c9ed-4313-97bc-39c8286c4f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44', 'volume_size': 1} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Flow 'volume_create_manager' (9ae60da8-ba8d-40ab-b282-8353fe1b5347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:27 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330fef5e-0c56-4196-ac27-16f1d8a81ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (330fef5e-0c56-4196-ac27-16f1d8a81ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee3dfce-4a85-45bc-8364-be361e7ee633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be3f9fe8eea456093ec9291d8b7518f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:28Z,use_quota=True,user_id='f1a175584a51471fbf4b913257e3c6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c94692bc-3ebe-41b2-a992-23cf1f67df87),volume_type_id=c94692bc-3ebe-41b2-a992-23cf1f67df87)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8197a9-e2b2-4b57-a1ee-2c87a0106734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee8197a9-e2b2-4b57-a1ee-2c87a0106734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189fd72a-2993-4f6d-a9a2-7a3ae11b3e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630" returned: 0 in 0.336s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1637052143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee2b303f-daad-4f3f-a859-8d687e03f921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:25Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Creating volume ee2b303f-daad-4f3f-a859-8d687e03f921 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:28 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6315dc6c-b5ea-4eaf-9768-81b26acd5fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cbae2d-bfb1-479e-a38b-0db2b6617cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921 1073741824 Sep 23 00:38:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Volume volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 (b3debbd4-b2eb-40bc-9d99-98eb93b7f630): created successfully Sep 23 00:38:28 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66cbae2d-bfb1-479e-a38b-0db2b6617cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (a704ba57-8916-40f6-b559-08acb6c391f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:28 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-7d744cbd-4541-410a-8f19-0d6f0725c544 tempest-CreateVolumesFromImageTest-519855524 None] Created volume successfully. Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (0ff5eb8a-f0bb-45b3-a105-bcad1b007e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2fdfdf-0a7e-4e2f-9f51-cef9e0167792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2fdfdf-0a7e-4e2f-9f51-cef9e0167792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021599770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f08754a-e63b-4286-ae0c-577d15a104bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:28Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4806329-8196-49c1-9ee5-0ad1e651e1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4806329-8196-49c1-9ee5-0ad1e651e1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89653b71-803c-427c-9bd9-aac233a26475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89653b71-803c-427c-9bd9-aac233a26475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f08754a-e63b-4286-ae0c-577d15a104bf', 'volume_name': 'volume-6f08754a-e63b-4286-ae0c-577d15a104bf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e632f0-52e2-4a01-aa61-5120e65f69a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e632f0-52e2-4a01-aa61-5120e65f69a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd70ad6-1416-4487-bffb-64e2586e4815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume 6f08754a-e63b-4286-ae0c-577d15a104bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f08754a-e63b-4286-ae0c-577d15a104bf', 'volume_size': 1} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189fd72a-2993-4f6d-a9a2-7a3ae11b3e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ee3dfce-4a85-45bc-8364-be361e7ee633', 'volume_name': 'volume-2ee3dfce-4a85-45bc-8364-be361e7ee633', 'volume_size': 1, 'image_id': '028cb381-19d3-4c6d-9c60-76938350fb5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/028cb381-19d3-4c6d-9c60-76938350fb5b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8adf3cdf9d7a60046b358bd4d4f71e79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6be3f9fe8eea456093ec9291d8b7518f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5c641b4f1a9a80462780f54b21a9f20d5c28b90f3f0c3cd3ee3d5db989b50fe761caab8d06c0608459c9f4b8d6878001144053b051fc899af05550b43b3f289', 'id': '028cb381-19d3-4c6d-9c60-76938350fb5b', 'created_at': datetime.datetime(2026, 9, 22, 22, 38, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 38, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/028cb381-19d3-4c6d-9c60-76938350fb5b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c158c5f-3565-47f0-86e2-dca899d95255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c158c5f-3565-47f0-86e2-dca899d95255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee3c7ed-05e4-4111-87dd-32c280b12974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Volume 2ee3dfce-4a85-45bc-8364-be361e7ee633: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ee3dfce-4a85-45bc-8364-be361e7ee633', 'volume_size': 1, 'image_id': '028cb381-19d3-4c6d-9c60-76938350fb5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/028cb381-19d3-4c6d-9c60-76938350fb5b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8adf3cdf9d7a60046b358bd4d4f71e79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6be3f9fe8eea456093ec9291d8b7518f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5c641b4f1a9a80462780f54b21a9f20d5c28b90f3f0c3cd3ee3d5db989b50fe761caab8d06c0608459c9f4b8d6878001144053b051fc899af05550b43b3f289', 'id': '028cb381-19d3-4c6d-9c60-76938350fb5b', 'created_at': datetime.datetime(2026, 9, 22, 22, 38, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 38, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/028cb381-19d3-4c6d-9c60-76938350fb5b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Trying to clone 2ee3dfce-4a85-45bc-8364-be361e7ee633 from image 028cb381-19d3-4c6d-9c60-76938350fb5b at location (None, [{'url': 'file:///opt/stack/data/glance/images/028cb381-19d3-4c6d-9c60-76938350fb5b', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:38:28 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921 1073741824" returned: 0 in 0.522s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:38:28 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:28 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921 Sep 23 00:38:28 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[378ab5f9-43a3-42e8-8d73-8181e9ff346b]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:28 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD Sep 23 00:38:28 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:28 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921" returned: 0 in 0.289s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.160s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645127190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d5fdce-d92c-42b3-a398-cdb11a849d11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:25Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Creating volume 11d5fdce-d92c-42b3-a398-cdb11a849d11 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:28 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31b6b594-81ca-460f-a330-9cd5746c1c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee2b303f-daad-4f3f-a859-8d687e03f921', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 1073741824 Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4562308-84c6-455b-9d07-b46f7bae92fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:28 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:28 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Volume volume-ee2b303f-daad-4f3f-a859-8d687e03f921 (ee2b303f-daad-4f3f-a859-8d687e03f921): created successfully Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4562308-84c6-455b-9d07-b46f7bae92fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:28 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (4e95e420-b124-4e22-8f87-927f52883a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-daf31fa7-4b55-4ac9-81c2-cbfd81622c36 tempest-CreateVolumesFromImageTest-519855524 None] Created volume successfully. Sep 23 00:38:29 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:29 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD Sep 23 00:38:29 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:29 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Temporary image 028cb381-19d3-4c6d-9c60-76938350fb5b is fetched for user f1a175584a51471fbf4b913257e3c6fc. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:38:29 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8456d19-fea8-4d35-9b2b-9bda7c1252a8]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 1073741824" returned: 0 in 0.552s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:29 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 Sep 23 00:38:29 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:29 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD Sep 23 00:38:29 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:29 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11" returned: 0 in 0.248s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.379s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1731620818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260f9a8d-c154-4052-99b1-1129f3a8837e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='650a6810ff8c45ee80e6a0f81dc8dfe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:26Z,use_quota=True,user_id='98a67da0c213422380e676f0cdb5d9ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Creating volume 260f9a8d-c154-4052-99b1-1129f3a8837e {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:29 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a5ec87-9ffd-423d-a734-3a9100f0c46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d5fdce-d92c-42b3-a398-cdb11a849d11', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b02ac3-b08b-4f92-a8be-21dcb320b274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:29 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:29 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e 1073741824 Sep 23 00:38:29 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:29 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Volume volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 (11d5fdce-d92c-42b3-a398-cdb11a849d11): created successfully Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8b02ac3-b08b-4f92-a8be-21dcb320b274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:29 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (ed770a1c-8a22-406c-94a2-e2c7739fc592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4026db47-405e-48a7-a7ec-f338440603af tempest-CreateVolumesFromImageTest-519855524 None] Created volume successfully. Sep 23 00:38:29 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD Sep 23 00:38:29 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:30 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:30 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e 1073741824" returned: 0 in 0.471s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:30 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e Sep 23 00:38:30 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:30 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e" returned: 0 in 0.277s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.820s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-502493000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7308e9-3d53-4b43-9e54-7b31401176df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:26Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Creating volume 2f7308e9-3d53-4b43-9e54-7b31401176df {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:30 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d386a418-9bae-4dc6-a69e-c406b0692457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260f9a8d-c154-4052-99b1-1129f3a8837e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:30 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df 1073741824 Sep 23 00:38:30 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aafac4-f96b-4b23-9552-c563a676bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:30 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Volume volume-260f9a8d-c154-4052-99b1-1129f3a8837e (260f9a8d-c154-4052-99b1-1129f3a8837e): created successfully Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21aafac4-f96b-4b23-9552-c563a676bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Flow 'volume_create_manager' (2acc6ccf-f815-4dce-a9c5-04f421681357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:30 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-38e4a2a3-ff96-4e8f-b24c-1a94f4c447b2 tempest-CreateVolumesFromImageTest-519855524 None] Created volume successfully. Sep 23 00:38:31 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df 1073741824" returned: 0 in 0.454s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:31 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df Sep 23 00:38:31 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:31 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df" returned: 0 in 0.242s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.401s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Creating offline snapshot 2d56622f-514e-4fef-a1a6-f14664f66f79 of volume e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec1b214-efbc-4728-98fb-43eb1d142d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f7308e9-3d53-4b43-9e54-7b31401176df', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c0f03e-c8d2-4468-88b9-aa5810dd33a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5abc7ba-a0b7-4625-b61d-0dc8d960264f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:31 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume volume-2f7308e9-3d53-4b43-9e54-7b31401176df (2f7308e9-3d53-4b43-9e54-7b31401176df): created successfully Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c0f03e-c8d2-4468-88b9-aa5810dd33a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (3d7444cc-3dce-4e37-afbb-c9a2c677dba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:31 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-cf2ab070-510a-4a33-9e7e-6086dcd7fd37 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created volume successfully. Sep 23 00:38:31 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 Sep 23 00:38:31 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-260f9a8d-c154-4052-99b1-1129f3a8837e-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-260f9a8d-c154-4052-99b1-1129f3a8837e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-quobyte-260f9a8d-c154-4052-99b1-1129f3a8837e" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-260f9a8d-c154-4052-99b1-1129f3a8837e" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:31 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" returned: 0 in 0.406s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8503d70-0a47-485d-a115-de45fe573847]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:31 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 1G Sep 23 00:38:31 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:31 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e Sep 23 00:38:31 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:32 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:32 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 1G" returned: 0 in 0.426s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e" returned: 0 in 0.425s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:32 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 Sep 23 00:38:32 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:32 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e Sep 23 00:38:32 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:32 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-260f9a8d-c154-4052-99b1-1129f3a8837e" returned: 0 in 0.282s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-260f9a8d-c154-4052-99b1-1129f3a8837e" released by "delete_volume" :: held 0.756s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:32 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79" returned: 0 in 0.329s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:32 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 is being set with open permissions: ugo+rw Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:32 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 Sep 23 00:38:32 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Created reservations ['ac4c8cbd-cda3-4921-bf50-f66d6ae1eb7f', '2683c783-502b-470c-94ab-0037d195ab5e', '33e3e018-c9e7-47e3-902d-b946317ae2a5', '6c152e5d-2333-4df8-a097-ba6c36c2af53', '732f44d8-ee8e-4460-be76-778546d52b39'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:32 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:32 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:32 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79" returned: 0 in 0.272s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:32 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.info Sep 23 00:38:32 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-11d5fdce-d92c-42b3-a398-cdb11a849d11-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-11d5fdce-d92c-42b3-a398-cdb11a849d11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:32 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-quobyte-11d5fdce-d92c-42b3-a398-cdb11a849d11" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.305s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:32 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Deleted volume successfully. Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-11d5fdce-d92c-42b3-a398-cdb11a849d11" acquired by "delete_volume" :: waited 0.048s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f6fbc13c-96ee-4049-94dc-777385e43293 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-260f9a8d-c154-4052-99b1-1129f3a8837e-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b3c988-0075-4ace-9e09-c969232e0c9e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:33 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.info" returned: 0 in 0.301s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:33 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.info is being set with open permissions: ugo+rw Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:33 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 Sep 23 00:38:33 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:33 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.info Sep 23 00:38:33 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:33 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.info" returned: 0 in 0.266s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.339s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-118168351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43c6519-77d5-4876-b195-572b2472cb27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:27Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Creating volume f43c6519-77d5-4876-b195-572b2472cb27 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:33 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:33 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11" returned: 0 in 0.406s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:33 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c282578f-cbc3-4f4e-972d-863be49b2f04 tempest-VolumeDependencyTests-1755904105 None] Create snapshot completed successfully Sep 23 00:38:33 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27 1073741824 Sep 23 00:38:33 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:33 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11 Sep 23 00:38:33 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:33 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-11d5fdce-d92c-42b3-a398-cdb11a849d11" returned: 0 in 0.306s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-11d5fdce-d92c-42b3-a398-cdb11a849d11" released by "delete_volume" :: held 0.778s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Created reservations ['3e279404-4494-427d-9886-67255b72489f', '142a9230-d605-46c8-9d77-7490445ac57c', 'b8c04b69-4947-4d8c-ba30-08af9e96d3a3', '10014e57-ccef-435e-acd3-2fe2ac37fb29', 'c7a1798b-7d2b-4e46-a50c-5fc7c2bf395d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:33 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27 1073741824" returned: 0 in 0.507s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:34 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:34 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:34 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27 Sep 23 00:38:34 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-ee2b303f-daad-4f3f-a859-8d687e03f921-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-ee2b303f-daad-4f3f-a859-8d687e03f921-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-quobyte-ee2b303f-daad-4f3f-a859-8d687e03f921" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-ee2b303f-daad-4f3f-a859-8d687e03f921" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6d3025-21c8-46ba-886e-4914f762ce00]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:34 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:34 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.357s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27" returned: 0 in 0.331s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.091s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-195853806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89187670-b3f2-452c-a1e7-df9febbc9b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:27Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Creating volume 89187670-b3f2-452c-a1e7-df9febbc9b5a {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:34 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:34 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Deleted volume successfully. Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe04e16d-8fa2-4df8-bc67-5df13146bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f43c6519-77d5-4876-b195-572b2472cb27', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:34 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a 1073741824 Sep 23 00:38:34 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f49de17-1982-49eb-bfbb-a5ba4195edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:34 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume volume-f43c6519-77d5-4876-b195-572b2472cb27 (f43c6519-77d5-4876-b195-572b2472cb27): created successfully Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f49de17-1982-49eb-bfbb-a5ba4195edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (cd9136ce-1a64-4262-9c48-7c219954c378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a268c0bb-54cc-42e5-98c1-ba5cd409483e tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-11d5fdce-d92c-42b3-a398-cdb11a849d11-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:34 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c8034b17-ea36-45d2-8c38-702b6a612f4e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created volume successfully. Sep 23 00:38:34 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921 Sep 23 00:38:34 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:34 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921" returned: 0 in 0.485s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:34 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921 Sep 23 00:38:34 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:34 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Flow 'volume_create_manager' (e35c8d02-ef00-4019-84be-18c09887802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1a6c2d-1921-4206-9bd0-e8696fa50954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a 1073741824" returned: 0 in 0.596s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b1a6c2d-1921-4206-9bd0-e8696fa50954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-293070979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681ceded-a73a-4844-8d96-39d1fdfe03a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e01ac9ba19c64f7fae68782541e8e33c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2d56622f-514e-4fef-a1a6-f14664f66f79,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:35Z,use_quota=True,user_id='be1008d2b41d4a508329128d81f740f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c40158e-af17-4938-b640-9095e3b1dfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c40158e-af17-4938-b640-9095e3b1dfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b91d1a3-918e-42a8-817f-a4b2691cc016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b91d1a3-918e-42a8-817f-a4b2691cc016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '681ceded-a73a-4844-8d96-39d1fdfe03a1', 'volume_name': 'volume-681ceded-a73a-4844-8d96-39d1fdfe03a1', 'volume_size': 1, 'snapshot_id': '2d56622f-514e-4fef-a1a6-f14664f66f79'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed32b683-933e-455a-b226-36b19522868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed32b683-933e-455a-b226-36b19522868e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47cc801-5c27-45c5-96ab-944462556ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Volume 681ceded-a73a-4844-8d96-39d1fdfe03a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-681ceded-a73a-4844-8d96-39d1fdfe03a1', 'volume_size': 1, 'snapshot_id': '2d56622f-514e-4fef-a1a6-f14664f66f79'} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:35 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a Sep 23 00:38:35 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:35 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee2b303f-daad-4f3f-a859-8d687e03f921" returned: 0 in 0.301s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-ee2b303f-daad-4f3f-a859-8d687e03f921" released by "delete_volume" :: held 0.843s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Created reservations ['3bb99c67-793e-4e88-8019-5edab1830a82', 'a3c770ae-5097-4161-8fa7-da53b64da216', 'd9667993-8e72-4abe-b432-bc16e4c9cec4', 'f481bb6b-5601-460c-a1db-ffa1bfcad6ce', 'a9d4303b-0bab-49c9-8d55-310e6f3b0712'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:35 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a" returned: 0 in 0.317s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:35 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:35 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.550s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1603155114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35a0dd6-c9ed-4313-97bc-39c8286c4f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:28Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Creating volume a35a0dd6-c9ed-4313-97bc-39c8286c4f44 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:35 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5362c226-7e60-4b6e-af34-4f1e9d7d09b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89187670-b3f2-452c-a1e7-df9febbc9b5a', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e723ebf9-a72e-40a2-92c0-19626832326f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:35 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 1073741824 Sep 23 00:38:35 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-b3debbd4-b2eb-40bc-9d99-98eb93b7f630-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume volume-89187670-b3f2-452c-a1e7-df9febbc9b5a (89187670-b3f2-452c-a1e7-df9febbc9b5a): created successfully Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e723ebf9-a72e-40a2-92c0-19626832326f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (45a6c78a-c21c-4012-a9a6-b6f50b3b79f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-b3debbd4-b2eb-40bc-9d99-98eb93b7f630-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-cdd57de9-38ed-408a-8935-2fac331208a0 tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created volume successfully. Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-quobyte-b3debbd4-b2eb-40bc-9d99-98eb93b7f630" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-b3debbd4-b2eb-40bc-9d99-98eb93b7f630" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d258182-0f0b-49f2-b658-0b07df099959]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:35 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.298s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Deleted volume successfully. Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3caf1888-4eef-4918-a2f1-52e61fca2800 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-ee2b303f-daad-4f3f-a859-8d687e03f921-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:35 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 Sep 23 00:38:35 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:35 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 1073741824" returned: 0 in 0.532s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:36 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 Sep 23 00:38:36 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:36 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630" returned: 0 in 0.452s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:36 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630 Sep 23 00:38:36 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:36 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44" returned: 0 in 0.283s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.838s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2021599770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f08754a-e63b-4286-ae0c-577d15a104bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e536e8f558244935bc69f949b847c98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:28Z,use_quota=True,user_id='c9d2264656c64dd19007d2db38304445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Creating volume 6f08754a-e63b-4286-ae0c-577d15a104bf {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:36 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793d8ea1-1f7a-4809-a3b2-2a64aaa03c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:36 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf 1073741824 Sep 23 00:38:36 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b37abe5-0f1d-4089-9228-bd7a1a6984e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:36 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 (a35a0dd6-c9ed-4313-97bc-39c8286c4f44): created successfully Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b37abe5-0f1d-4089-9228-bd7a1a6984e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (f2cb05c5-5c94-4071-b3e5-2e27b6f3e85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-02979f23-d88b-47da-ab51-b2c77325640c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created volume successfully. Sep 23 00:38:36 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-b3debbd4-b2eb-40bc-9d99-98eb93b7f630" returned: 0 in 0.311s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-b3debbd4-b2eb-40bc-9d99-98eb93b7f630" released by "delete_volume" :: held 0.813s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Created reservations ['6e5737c1-7dda-4959-be0f-d646d100a32c', 'f30c4d84-b676-4def-8a8b-c450ec2145eb', '7ef1fdca-d209-4386-b623-4108c5902638', '555ca938-51d8-45f9-9b8d-a65c8b7abb75', '68a0eda0-66a9-45fe-9e47-1d2347ccfe18'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:36 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:36 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-d57a82bd-e917-4612-8df1-f8cd4abac2fd-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-d57a82bd-e917-4612-8df1-f8cd4abac2fd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "cinder-quobyte-d57a82bd-e917-4612-8df1-f8cd4abac2fd" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-d57a82bd-e917-4612-8df1-f8cd4abac2fd" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d81988a-84d6-466a-809f-19e7971f0b85]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:36 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf 1073741824" returned: 0 in 0.553s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:36 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.314s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Deleted volume successfully. Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5cc36b34-b6fe-42ca-a020-b6836701d513 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-b3debbd4-b2eb-40bc-9d99-98eb93b7f630-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:36 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd Sep 23 00:38:36 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:36 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf Sep 23 00:38:36 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:37 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf" returned: 0 in 0.280s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.997s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee3dfce-4a85-45bc-8364-be361e7ee633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be3f9fe8eea456093ec9291d8b7518f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:28Z,use_quota=True,user_id='f1a175584a51471fbf4b913257e3c6fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c94692bc-3ebe-41b2-a992-23cf1f67df87),volume_type_id=c94692bc-3ebe-41b2-a992-23cf1f67df87)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Creating volume 2ee3dfce-4a85-45bc-8364-be361e7ee633 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:37 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:37 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd" returned: 0 in 0.446s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:37 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 1073741824 Sep 23 00:38:37 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd70ad6-1416-4487-bffb-64e2586e4815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f08754a-e63b-4286-ae0c-577d15a104bf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0227c3f1-e178-4181-9c5f-7d2a03a1d9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:37 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd Sep 23 00:38:37 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:37 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Volume volume-6f08754a-e63b-4286-ae0c-577d15a104bf (6f08754a-e63b-4286-ae0c-577d15a104bf): created successfully Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0227c3f1-e178-4181-9c5f-7d2a03a1d9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Flow 'volume_create_manager' (0ff5eb8a-f0bb-45b3-a105-bcad1b007e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:37 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-57bc7e8c-aac5-4d98-b030-cb30f22b8e4b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created volume successfully. Sep 23 00:38:37 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-d57a82bd-e917-4612-8df1-f8cd4abac2fd" returned: 0 in 0.295s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-quobyte-d57a82bd-e917-4612-8df1-f8cd4abac2fd" released by "delete_volume" :: held 0.792s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Created reservations ['c94fd6b6-4464-4ec0-a170-2e308871ee54', '1fb37825-8882-49db-9427-93be5848854a', '6cc5b6e4-d751-47bb-8c84-937cdb692ff9', '5c83c159-caf8-44d5-a975-59215238e566', '028d8949-c8f9-4c65-aa99-aacfe6361b93'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:37 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 1073741824" returned: 0 in 0.482s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:37 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:37 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:37 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 Sep 23 00:38:37 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:37 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.273s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:37 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:37 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Deleted volume successfully. Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a4eef15b-9a51-4b23-837e-483183fbe537 tempest-CreateVolumesFromImageTest-519855524 None] Lock "cinder-d57a82bd-e917-4612-8df1-f8cd4abac2fd-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:38 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633" returned: 0 in 0.291s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.981s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "cinder-quobyte-2d56622f-514e-4fef-a1a6-f14664f66f79-681ceded-a73a-4844-8d96-39d1fdfe03a1" by "_create_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-2d56622f-514e-4fef-a1a6-f14664f66f79-681ceded-a73a-4844-8d96-39d1fdfe03a1" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Creating volume 681ceded-a73a-4844-8d96-39d1fdfe03a1 from snapshot 2d56622f-514e-4fef-a1a6-f14664f66f79 {{(pid=87138) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "cinder-quobyte-681ceded-a73a-4844-8d96-39d1fdfe03a1" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Attempting download of 028cb381-19d3-4c6d-9c60-76938350fb5b ((None, [{'url': 'file:///opt/stack/data/glance/images/028cb381-19d3-4c6d-9c60-76938350fb5b', 'metadata': {}}])) to volume 2ee3dfce-4a85-45bc-8364-be361e7ee633. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-681ceded-a73a-4844-8d96-39d1fdfe03a1" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] snapshot: 2d56622f-514e-4fef-a1a6-f14664f66f79, volume: 681ceded-a73a-4844-8d96-39d1fdfe03a1, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47eceeb-b10f-4ec8-b5bb-c42020ebc4c6]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d740843a-de49-47a9-8fce-6e1567ea6510]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_028cb381-19d3-4c6d-9c60-76938350fb5b_uubt9fx9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-6f08754a-e63b-4286-ae0c-577d15a104bf-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-6f08754a-e63b-4286-ae0c-577d15a104bf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-quobyte-6f08754a-e63b-4286-ae0c-577d15a104bf" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-6f08754a-e63b-4286-ae0c-577d15a104bf" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:38 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_028cb381-19d3-4c6d-9c60-76938350fb5b_uubt9fx9 Sep 23 00:38:38 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:38 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 Sep 23 00:38:38 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9c9b56-b6e6-4c2b-b60e-5cad39a3eb83]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:38 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf Sep 23 00:38:38 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:38 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_028cb381-19d3-4c6d-9c60-76938350fb5b_uubt9fx9" returned: 0 in 0.446s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_028cb381-19d3-4c6d-9c60-76938350fb5b_uubt9fx9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:38 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79" returned: 0 in 0.499s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a3542d-e5ec-4940-adbd-ebc9ec7558fc]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:38 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_028cb381-19d3-4c6d-9c60-76938350fb5b_uubt9fx9 Sep 23 00:38:38 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:38 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf" returned: 0 in 0.466s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:38 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 Sep 23 00:38:38 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:38 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf Sep 23 00:38:38 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_028cb381-19d3-4c6d-9c60-76938350fb5b_uubt9fx9" returned: 1 in 0.375s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_028cb381-19d3-4c6d-9c60-76938350fb5b_uubt9fx9' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaed7af-5954-4da7-9922-c8d33fe2663f]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:39 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-6f08754a-e63b-4286-ae0c-577d15a104bf" returned: 0 in 0.368s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:39 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD Sep 23 00:38:39 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-6f08754a-e63b-4286-ae0c-577d15a104bf" released by "delete_volume" :: held 0.910s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:39 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" returned: 0 in 0.533s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:39 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 Sep 23 00:38:39 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created reservations ['ecf1be47-4f0f-48a5-b45d-a1a1b396c09a', '674c4373-0cc1-4e05-b6d5-687d24ec17fd', '2464971f-2a9d-475c-808d-34421c903f24', '8bae28da-21e5-46a7-b36d-698fd0e32eba', 'eb82a3ad-165e-41d5-9207-d7ec8ad25239'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:39 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:39 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:39 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-a35a0dd6-c9ed-4313-97bc-39c8286c4f44-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-a35a0dd6-c9ed-4313-97bc-39c8286c4f44-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-quobyte-a35a0dd6-c9ed-4313-97bc-39c8286c4f44" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-a35a0dd6-c9ed-4313-97bc-39c8286c4f44" acquired by "delete_volume" :: waited 0.026s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d246871e-d1f7-4398-b9af-31b8b634d1f8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:39 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD Sep 23 00:38:39 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 Sep 23 00:38:39 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:39 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.444s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:39 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Deleted volume successfully. Sep 23 00:38:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a278de6-941a-4c72-9f6e-ec734111d79a tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-6f08754a-e63b-4286-ae0c-577d15a104bf-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:40 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD" returned: 1 in 0.649s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:38:40 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] 028cb381-19d3-4c6d-9c60-76938350fb5b was raw, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:38:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:40 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 Sep 23 00:38:40 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:40 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44" returned: 0 in 0.706s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:40 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44 Sep 23 00:38:40 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:40 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-a35a0dd6-c9ed-4313-97bc-39c8286c4f44" returned: 0 in 0.501s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-a35a0dd6-c9ed-4313-97bc-39c8286c4f44" released by "delete_volume" :: held 1.313s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created reservations ['a52fe385-8b5e-465d-a5a8-5e20a5b27364', 'b0e37611-becc-4b3c-882b-e29dadffe93a', '54c420e8-36a5-48f3-a036-ffa9680716f2', '4318553d-ddaa-48fe-a106-1ca4baf9c712', 'd23a6f8e-a3bc-4b40-bb3c-7a3dc01cf766'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:41 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:41 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:41 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633" returned: 0 in 1.505s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_028cb381-19d3-4c6d-9c60-76938350fb5b_b3vdkuwodevstack@QuobyteHD, size 0.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:38:41 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:41 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 1G Sep 23 00:38:41 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:41 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.754s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:41 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:42 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Deleted volume successfully. Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bdaa8a40-0604-4eee-919b-f225cd32d58f tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-a35a0dd6-c9ed-4313-97bc-39c8286c4f44-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-89187670-b3f2-452c-a1e7-df9febbc9b5a-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-89187670-b3f2-452c-a1e7-df9febbc9b5a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-quobyte-89187670-b3f2-452c-a1e7-df9febbc9b5a" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-89187670-b3f2-452c-a1e7-df9febbc9b5a" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[113967d9-996c-4f68-8c96-5088c5858daf]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:42 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 1G" returned: 0 in 0.810s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Downloaded image 028cb381-19d3-4c6d-9c60-76938350fb5b ((None, [{'url': 'file:///opt/stack/data/glance/images/028cb381-19d3-4c6d-9c60-76938350fb5b', 'metadata': {}}])) to volume 2ee3dfce-4a85-45bc-8364-be361e7ee633 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Temporary image 028cb381-19d3-4c6d-9c60-76938350fb5b for user f1a175584a51471fbf4b913257e3c6fc is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Marking volume 2ee3dfce-4a85-45bc-8364-be361e7ee633 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:38:42 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a Sep 23 00:38:42 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Copying metadata from image 028cb381-19d3-4c6d-9c60-76938350fb5b to 2ee3dfce-4a85-45bc-8364-be361e7ee633. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Creating volume glance metadata for volume 2ee3dfce-4a85-45bc-8364-be361e7ee633 backed by image 028cb381-19d3-4c6d-9c60-76938350fb5b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '028cb381-19d3-4c6d-9c60-76938350fb5b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8adf3cdf9d7a60046b358bd4d4f71e79', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee3c7ed-05e4-4111-87dd-32c280b12974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee3dfce-4a85-45bc-8364-be361e7ee633', 'volume_size': 1, 'image_id': '028cb381-19d3-4c6d-9c60-76938350fb5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/028cb381-19d3-4c6d-9c60-76938350fb5b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8adf3cdf9d7a60046b358bd4d4f71e79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6be3f9fe8eea456093ec9291d8b7518f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a5c641b4f1a9a80462780f54b21a9f20d5c28b90f3f0c3cd3ee3d5db989b50fe761caab8d06c0608459c9f4b8d6878001144053b051fc899af05550b43b3f289', 'id': '028cb381-19d3-4c6d-9c60-76938350fb5b', 'created_at': datetime.datetime(2026, 9, 22, 22, 38, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 38, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/028cb381-19d3-4c6d-9c60-76938350fb5b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e5d6f9-47ee-4982-b4f5-94f9174989ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:42 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Volume volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 (2ee3dfce-4a85-45bc-8364-be361e7ee633): created successfully Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e5d6f9-47ee-4982-b4f5-94f9174989ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Flow 'volume_create_manager' (9ae60da8-ba8d-40ab-b282-8353fe1b5347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:42 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a7bb40b4-cd9f-46b3-90e5-9e4c0cea534c tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Created volume successfully. Sep 23 00:38:42 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a" returned: 0 in 0.640s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:43 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a Sep 23 00:38:43 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Acquiring lock "cinder-2ee3dfce-4a85-45bc-8364-be361e7ee633-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "cinder-2ee3dfce-4a85-45bc-8364-be361e7ee633-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Acquiring lock "cinder-quobyte-2ee3dfce-4a85-45bc-8364-be361e7ee633" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "cinder-quobyte-2ee3dfce-4a85-45bc-8364-be361e7ee633" acquired by "delete_volume" :: waited 0.042s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:43 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-89187670-b3f2-452c-a1e7-df9febbc9b5a" returned: 0 in 0.621s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-89187670-b3f2-452c-a1e7-df9febbc9b5a" released by "delete_volume" :: held 1.381s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c5b34b-61f2-4c3a-b8cb-311b7a575fcc]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created reservations ['0b0898ed-d4a8-4a4c-8fe3-53f5f74b5b10', 'bb00df27-2ae0-496d-90ef-d1b5676b518c', 'feeea602-42ad-45c2-b86d-fd5831999b7b', 'c08596fc-0568-417f-bf52-26b8db1f3cd1', '6a244a75-aabd-4e43-9a88-74e85c4276e8'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:43 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 Sep 23 00:38:43 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:44 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:44 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:44 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.445s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:44 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Deleted volume successfully. Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-bb99a745-030b-4d96-bf71-c6d438ec1a9b tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-89187670-b3f2-452c-a1e7-df9febbc9b5a-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:44 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633" returned: 0 in 0.919s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-f43c6519-77d5-4876-b195-572b2472cb27-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:44 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633 Sep 23 00:38:44 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-f43c6519-77d5-4876-b195-572b2472cb27-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-quobyte-f43c6519-77d5-4876-b195-572b2472cb27" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-f43c6519-77d5-4876-b195-572b2472cb27" acquired by "delete_volume" :: waited 0.055s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c9897d-e987-4906-8b6a-85d0b65522de]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:45 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27 Sep 23 00:38:45 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:45 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ee3dfce-4a85-45bc-8364-be361e7ee633" returned: 0 in 0.757s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "cinder-quobyte-2ee3dfce-4a85-45bc-8364-be361e7ee633" released by "delete_volume" :: held 1.781s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (4dfcb02b-0ea0-4495-9cb8-d952b0c6d466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b89b40-f293-4394-b073-1750ba0cecb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b89b40-f293-4394-b073-1750ba0cecb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-288615104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d1ab22-10f9-4b24-b0ac-64a201f9688f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:45Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1987491b-aaf1-41fd-bbd2-595843bf3dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1987491b-aaf1-41fd-bbd2-595843bf3dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e811d9-da78-4d9b-bcb6-d920ab778575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:45 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e811d9-da78-4d9b-bcb6-d920ab778575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d1ab22-10f9-4b24-b0ac-64a201f9688f', 'volume_name': 'volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb458d8-02ab-465c-98d6-15a064c73419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb458d8-02ab-465c-98d6-15a064c73419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c32d289-da42-4396-aed1-c76c8c2420e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Volume f7d1ab22-10f9-4b24-b0ac-64a201f9688f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f', 'volume_size': 1} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Created reservations ['9a5a9354-8803-4cce-b5d0-15a207ba799f', 'e86e5c5b-13b5-4ff8-bd0b-cff268a8ba21', 'ecb91b19-f999-495d-97c8-d41760b99efa', 'a7d90433-ac49-4e0c-9bbf-85090f829221', 'a970d324-d1c0-49dd-8b76-b49607fb1d7a'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27" returned: 0 in 0.891s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:45 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27 Sep 23 00:38:45 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:46 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:46 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:46 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f43c6519-77d5-4876-b195-572b2472cb27" returned: 0 in 0.576s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-f43c6519-77d5-4876-b195-572b2472cb27" released by "delete_volume" :: held 1.615s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created reservations ['f683b78a-725c-449f-a6ed-db29a84da2d9', '2b954bc0-221b-471a-bb16-b09fd957d023', '82a17e1f-da31-4c70-9bb6-d211be3fbfe0', 'f61768f1-a33d-4bfa-adc3-3b99a0235bd0', 'ca80bbfe-af2f-49f2-b785-adf655153a67'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:46 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.488s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Deleted volume successfully. Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3ddd340e-64e3-407c-b51b-45f13b2c39b5 tempest-VolumeAndVolumeTypeFromImageTest-342395441 None] Lock "cinder-2ee3dfce-4a85-45bc-8364-be361e7ee633-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:46 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:46 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:47 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.438s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:47 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:47 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Deleted volume successfully. Sep 23 00:38:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8e8be268-3b46-4550-a3c5-4d3b478441fd tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-f43c6519-77d5-4876-b195-572b2472cb27-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-2f7308e9-3d53-4b43-9e54-7b31401176df-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-2f7308e9-3d53-4b43-9e54-7b31401176df-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-quobyte-2f7308e9-3d53-4b43-9e54-7b31401176df" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-2f7308e9-3d53-4b43-9e54-7b31401176df" acquired by "delete_volume" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f620595-12d5-4c89-bfc7-97afacb2c480]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:47 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df Sep 23 00:38:47 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:48 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1" returned: 0 in 9.080s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516, size 1024.00 MB, duration 9.08 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:38:48 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:48 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Converted 1024.00 MB image at 112.75 MB/s Sep 23 00:38:48 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 is being set with open permissions: ugo+rw Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df" returned: 0 in 0.711s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:48 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 Sep 23 00:38:48 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:48 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df Sep 23 00:38:48 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:48 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1" returned: 0 in 0.290s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:48 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-681ceded-a73a-4844-8d96-39d1fdfe03a1" released by "_copy_volume_from_snapshot" :: held 10.541s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f7308e9-3d53-4b43-9e54-7b31401176df" returned: 0 in 0.296s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-2f7308e9-3d53-4b43-9e54-7b31401176df" released by "delete_volume" :: held 1.104s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-2d56622f-514e-4fef-a1a6-f14664f66f79-681ceded-a73a-4844-8d96-39d1fdfe03a1" released by "_create_volume_from_snapshot" :: held 10.637s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.665s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.936s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-288615104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d1ab22-10f9-4b24-b0ac-64a201f9688f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:45Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Creating volume f7d1ab22-10f9-4b24-b0ac-64a201f9688f {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:48 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:48 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f 1073741824 Sep 23 00:38:48 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47cc801-5c27-45c5-96ab-944462556ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681ceded-a73a-4844-8d96-39d1fdfe03a1', 'volume_size': 1, 'snapshot_id': '2d56622f-514e-4fef-a1a6-f14664f66f79'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4c5152-cfc1-4a81-af40-b5dcd3eba651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created reservations ['7565f5b5-aa71-408e-9972-2d015e6f7f07', 'd82c8ebe-2f3a-47b5-8087-88b536b1f623', '05b22a5e-0a63-4501-af04-1a217cf14c79', '26a4b6d7-1727-40eb-8d78-91bf355de18e', 'b7c9b3ba-15f2-421a-871e-5462250609da'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:48 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Volume volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 (681ceded-a73a-4844-8d96-39d1fdfe03a1): created successfully Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a4c5152-cfc1-4a81-af40-b5dcd3eba651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Flow 'volume_create_manager' (e35c8d02-ef00-4019-84be-18c09887802f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:48 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3093c80a-3ec1-4ac8-b605-696b8e8e0147 tempest-VolumeDependencyTests-1755904105 None] Created volume successfully. Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:48 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:48 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:49 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.314s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Deleted volume successfully. Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d73d03f8-b908-4884-8cdc-23a5d529cf2c tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-2f7308e9-3d53-4b43-9e54-7b31401176df-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:49 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f 1073741824" returned: 0 in 0.559s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:49 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f Sep 23 00:38:49 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "cinder-2d56622f-514e-4fef-a1a6-f14664f66f79-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-2d56622f-514e-4fef-a1a6-f14664f66f79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "cinder-quobyte-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "cinder-quobyte-2d56622f-514e-4fef-a1a6-f14664f66f79" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-2d56622f-514e-4fef-a1a6-f14664f66f79" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Deleting offline snapshot 2d56622f-514e-4fef-a1a6-f14664f66f79 of volume e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:49 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] snapshot_file for this snap is: volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" returned: 0 in 0.312s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a5ad9b-9061-457f-825d-d6ae8222c900]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c32d289-da42-4396-aed1-c76c8c2420e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae51c28-43d0-430f-9cff-01dfdcb84b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-499ea6b1-7264-46e0-9447-2f72e65caa4e-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:49 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Volume volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f (f7d1ab22-10f9-4b24-b0ac-64a201f9688f): created successfully Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae51c28-43d0-430f-9cff-01dfdcb84b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (4dfcb02b-0ea0-4495-9cb8-d952b0c6d466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-499ea6b1-7264-46e0-9447-2f72e65caa4e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-31c80182-0a77-4d9a-b0a2-6b1e0bc84459 tempest-ProjectMemberTests-665542472 None] Created volume successfully. Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "cinder-quobyte-499ea6b1-7264-46e0-9447-2f72e65caa4e" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:49 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 Sep 23 00:38:49 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-499ea6b1-7264-46e0-9447-2f72e65caa4e" acquired by "delete_volume" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[305fa810-02a3-4035-ada4-380a7e944576]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:49 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e Sep 23 00:38:49 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:50 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79" returned: 0 in 0.454s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[959f0a34-3022-4c59-8d70-3d72202ceccc]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:50 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:50 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 Sep 23 00:38:50 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e" returned: 0 in 0.423s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:50 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e Sep 23 00:38:50 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:50 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-499ea6b1-7264-46e0-9447-2f72e65caa4e" returned: 0 in 0.279s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-quobyte-499ea6b1-7264-46e0-9447-2f72e65caa4e" released by "delete_volume" :: held 0.760s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Created reservations ['92ea57e6-7f41-4602-ad44-65128e35a22d', '7e128d99-ff5c-43b1-a521-9dca996d72be', 'c89c375d-966c-4760-82fe-00afb881477a', 'accddbf5-b905-4edb-ab25-8a01b85a0ea6', 'c0701089-8f49-4990-ab37-9de852974523'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:50 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" returned: 0 in 0.618s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:50 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:50 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:50 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 Sep 23 00:38:50 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:51 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.395s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Deleted volume successfully. Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-94773e48-2d82-4efd-a80a-93764968392e tempest-CreateVolumesFromSourceVolumeTest-1089606682 None] Lock "cinder-499ea6b1-7264-46e0-9447-2f72e65caa4e-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:51 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79" returned: 0 in 0.477s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:51 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79 Sep 23 00:38:51 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Creating offline snapshot e9f1d586-f7e5-44f9-8f88-e3f43fda66fb of volume f7d1ab22-10f9-4b24-b0ac-64a201f9688f {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d80576-1184-4044-87f7-144af5f1e7fc]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:51 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516.2d56622f-514e-4fef-a1a6-f14664f66f79" returned: 0 in 0.348s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-2d56622f-514e-4fef-a1a6-f14664f66f79" released by "_delete_snapshot" :: held 2.076s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" released by "delete_snapshot" :: held 2.107s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:51 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f Sep 23 00:38:51 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Created reservations ['11c28c0a-87c7-4b47-b3d4-11ba9b37b3d4', '893eba7c-6cc1-495f-a51d-a57419c31ff7', '78650f8c-7316-4002-a3c9-c57e7240ef14', '03aa40e5-ea42-40c9-9bc4-2a4bb7e3be80', '056e0b60-edf0-40f1-af16-46e4080aeda4'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Delete snapshot completed successfully. Sep 23 00:38:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8650ce9f-3338-4f46-9f58-f5892edca349 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-2d56622f-514e-4fef-a1a6-f14664f66f79-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:52 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" returned: 0 in 0.458s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:52 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb 1G Sep 23 00:38:52 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:52 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb 1G" returned: 0 in 0.514s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:52 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb Sep 23 00:38:52 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "cinder-e238fda1-1b66-4748-9e1a-2e9d9ad0b516-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-e238fda1-1b66-4748-9e1a-2e9d9ad0b516-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "cinder-quobyte-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:52 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb" returned: 0 in 0.392s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:52 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb is being set with open permissions: ugo+rw Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee772340-99ec-42cd-9d3f-68535e2dd1b2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:53 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb Sep 23 00:38:53 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:53 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 Sep 23 00:38:53 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:53 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb" returned: 0 in 0.442s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (b88a23fa-a545-4b7d-a5c9-04b84258e54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c86cec-cc25-41d6-8b58-2ba868c73efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c86cec-cc25-41d6-8b58-2ba868c73efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-420313920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c074119-8d16-48d8-8cc9-a3f37ac5d9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:53Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:53 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c97961-158c-4c0f-a9b4-e22947635b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3c97961-158c-4c0f-a9b4-e22947635b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1a0aba-59a1-425d-82d7-f002b4875925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1a0aba-59a1-425d-82d7-f002b4875925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c074119-8d16-48d8-8cc9-a3f37ac5d9e6', 'volume_name': 'volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9da9c6-c070-4a32-8564-6f89e41c4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9da9c6-c070-4a32-8564-6f89e41c4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bf156b-7bb0-4295-a2e3-96b428195388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:53 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume 9c074119-8d16-48d8-8cc9-a3f37ac5d9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6', 'volume_size': 1} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" returned: 0 in 0.562s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:53 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516 Sep 23 00:38:53 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:53 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.info Sep 23 00:38:53 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:53 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" returned: 0 in 0.259s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-e238fda1-1b66-4748-9e1a-2e9d9ad0b516" released by "delete_volume" :: held 0.910s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:53 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.info" returned: 0 in 0.284s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:53 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.info is being set with open permissions: ugo+rw Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:53 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.info Sep 23 00:38:53 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Created reservations ['cb8f7a40-d336-4573-8a06-9c7645e95717', 'dc1e7961-fef9-440d-95e9-13e5041435df', '8f42209b-38a7-41d2-84ff-72fdb61f4782', 'c1cab6e6-09d5-4306-829a-d40755131360', 'df3ffa19-96f5-451e-8d13-a116a5e430ff'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:54 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:54 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:54 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.info" returned: 0 in 0.310s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.639s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.640s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-420313920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c074119-8d16-48d8-8cc9-a3f37ac5d9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:53Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Creating volume 9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:38:54 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:54 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 1073741824 Sep 23 00:38:54 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8c439b79-9557-447e-95fd-c097163564ba tempest-ProjectMemberTests-665542472 None] Create snapshot completed successfully Sep 23 00:38:54 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.274s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Deleted volume successfully. Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6582d8a9-323f-49ab-b455-5eadbd94c3b0 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-e238fda1-1b66-4748-9e1a-2e9d9ad0b516-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-e9f1d586-f7e5-44f9-8f88-e3f43fda66fb-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Lock "cinder-e9f1d586-f7e5-44f9-8f88-e3f43fda66fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:54 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-e9f1d586-f7e5-44f9-8f88-e3f43fda66fb" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 1073741824" returned: 0 in 0.523s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-e9f1d586-f7e5-44f9-8f88-e3f43fda66fb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Deleting offline snapshot e9f1d586-f7e5-44f9-8f88-e3f43fda66fb of volume f7d1ab22-10f9-4b24-b0ac-64a201f9688f {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] snapshot_file for this snap is: volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6106262f-a188-45bf-b092-1ced721b223b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:54 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 Sep 23 00:38:54 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:54 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb Sep 23 00:38:54 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:55 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" returned: 0 in 0.286s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "cinder-681ceded-a73a-4844-8d96-39d1fdfe03a1-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9bf156b-7bb0-4295-a2e3-96b428195388) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf42921f-0c60-447f-87d5-1058aff22f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-681ceded-a73a-4844-8d96-39d1fdfe03a1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:55 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 (9c074119-8d16-48d8-8cc9-a3f37ac5d9e6): created successfully Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf42921f-0c60-447f-87d5-1058aff22f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (b88a23fa-a545-4b7d-a5c9-04b84258e54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:55 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f2cb1746-77de-4507-8f3d-d704aeafc7e8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created volume successfully. Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "cinder-quobyte-681ceded-a73a-4844-8d96-39d1fdfe03a1" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-681ceded-a73a-4844-8d96-39d1fdfe03a1" acquired by "delete_volume" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:55 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb" returned: 0 in 0.468s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26ff5e2-ad7e-42ee-b741-879d9b0c3ef5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd93b2a-3fb9-4464-9ca8-b11c0c16eddf]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:55 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 Sep 23 00:38:55 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:55 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f Sep 23 00:38:55 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:55 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1" returned: 0 in 0.471s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:55 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" returned: 0 in 0.490s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:55 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1 Sep 23 00:38:55 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:55 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb Sep 23 00:38:55 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Creating offline snapshot 275ac186-1a37-4366-ac25-82514e17c577 of volume 9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60a2539-81d9-4ebe-a252-bf4cef34ce4c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:55 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 Sep 23 00:38:55 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:56 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-681ceded-a73a-4844-8d96-39d1fdfe03a1" returned: 0 in 0.318s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-quobyte-681ceded-a73a-4844-8d96-39d1fdfe03a1" released by "delete_volume" :: held 0.853s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Created reservations ['24cab11d-73f6-4637-8406-c3e1ef32fee8', '294ced18-17b8-42b5-91b4-7339a5a4699a', 'cc43fb7f-91ad-4c88-803b-60a1b0d8d075', '40e00831-2f12-40a9-a1c4-82acabb89348', '19d9fb1d-57e3-4057-83f0-aa729149c3ce'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:56 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb" returned: 0 in 0.443s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:56 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb Sep 23 00:38:56 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:56 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:56 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:56 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" returned: 0 in 0.534s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:56 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 1G Sep 23 00:38:56 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:56 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.308s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:56 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f.e9f1d586-f7e5-44f9-8f88-e3f43fda66fb" returned: 0 in 0.396s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Deleted volume successfully. Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-85417a36-f526-4cda-b1c2-4e19902509d3 tempest-VolumeDependencyTests-1755904105 None] Lock "cinder-681ceded-a73a-4844-8d96-39d1fdfe03a1-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-e9f1d586-f7e5-44f9-8f88-e3f43fda66fb" released by "_delete_snapshot" :: held 1.962s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" released by "delete_snapshot" :: held 1.992s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Created reservations ['050e4d69-7e96-4dcf-b968-ed3d8d575a27', 'f223a809-fdb3-4b00-a0ec-3b8c72942f72', '97c548a5-cb04-45e6-9e36-6ba254c9edbf', '95abc6fa-2127-4fa0-aa6e-fde45ae7abd1', 'ab97c179-1cb2-49f1-aed5-4f2b0754db45'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Delete snapshot completed successfully. Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-75dc4aff-4e1b-48aa-a01c-97b393cc5f96 tempest-ProjectMemberTests-665542472 None] Lock "cinder-e9f1d586-f7e5-44f9-8f88-e3f43fda66fb-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:56 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 1G" returned: 0 in 0.605s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:57 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 Sep 23 00:38:57 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:57 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577" returned: 0 in 0.354s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:57 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 is being set with open permissions: ugo+rw Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:57 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 Sep 23 00:38:57 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:57 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577" returned: 0 in 0.347s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:38:57 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.info Sep 23 00:38:57 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Flow 'volume_create_manager' (92f2986e-3bc7-4a7f-a487-8203de71645b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab55cfc5-7e31-4d94-9ed4-8c61834eca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab55cfc5-7e31-4d94-9ed4-8c61834eca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798daa6b-79d3-4581-a926-01ff273e3691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8fc45ab92842ab9e31d92efbbdaebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:58Z,use_quota=True,user_id='a385d7871bf443dcbc0e107fc8d4d787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa5846b-7c89-4dd8-a605-e15ea9da6a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fa5846b-7c89-4dd8-a605-e15ea9da6a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2363dd3b-0fb5-42aa-a257-ee16ab2fce91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.image.glance [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Creating Keystone auth plugin from conf {{(pid=87138) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-f7d1ab22-10f9-4b24-b0ac-64a201f9688f-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Lock "cinder-f7d1ab22-10f9-4b24-b0ac-64a201f9688f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb6930-774c-4754-b111-c12d51d75236]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:58 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.info" returned: 0 in 0.395s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:58 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.info is being set with open permissions: ugo+rw Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:58 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.info Sep 23 00:38:58 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:58 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f Sep 23 00:38:58 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2363dd3b-0fb5-42aa-a257-ee16ab2fce91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '798daa6b-79d3-4581-a926-01ff273e3691', 'volume_name': 'volume-798daa6b-79d3-4581-a926-01ff273e3691', 'volume_size': 1, 'image_id': '2588182b-d83e-45c5-9b5b-050d83ec4eba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2588182b-d83e-45c5-9b5b-050d83ec4eba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce17d5af30b9b10e7854cd8c95688818', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc8fc45ab92842ab9e31d92efbbdaebd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b2457db2d2c10eb1bf9c870dc4e1f8a00ae1eb07dd716c8d09a25acb4b4934c8a19f9376ae9ea1a8e81bb32c0531903073335d7a5393a82ebdb6c07edc92b0e', 'id': '2588182b-d83e-45c5-9b5b-050d83ec4eba', 'created_at': datetime.datetime(2026, 9, 22, 22, 38, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 38, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2588182b-d83e-45c5-9b5b-050d83ec4eba/file', 'properties': {}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087899f0-de16-4218-85a0-82fbcc772926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (087899f0-de16-4218-85a0-82fbcc772926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e04dc35-6b58-4320-b434-a3999c9226cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:38:58 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Volume 798daa6b-79d3-4581-a926-01ff273e3691: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-798daa6b-79d3-4581-a926-01ff273e3691', 'volume_size': 1, 'image_id': '2588182b-d83e-45c5-9b5b-050d83ec4eba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2588182b-d83e-45c5-9b5b-050d83ec4eba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce17d5af30b9b10e7854cd8c95688818', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc8fc45ab92842ab9e31d92efbbdaebd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b2457db2d2c10eb1bf9c870dc4e1f8a00ae1eb07dd716c8d09a25acb4b4934c8a19f9376ae9ea1a8e81bb32c0531903073335d7a5393a82ebdb6c07edc92b0e', 'id': '2588182b-d83e-45c5-9b5b-050d83ec4eba', 'created_at': datetime.datetime(2026, 9, 22, 22, 38, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 38, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2588182b-d83e-45c5-9b5b-050d83ec4eba/file', 'properties': {}}, 'image_service': } Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Trying to clone 798daa6b-79d3-4581-a926-01ff273e3691 from image 2588182b-d83e-45c5-9b5b-050d83ec4eba at location (None, [{'url': 'file:///opt/stack/data/glance/images/2588182b-d83e-45c5-9b5b-050d83ec4eba', 'metadata': {}}]). {{(pid=87138) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 23 00:38:58 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.info" returned: 0 in 0.344s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.698s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-01f39b72-32e5-4978-a7d3-75b6665d6208 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Create snapshot completed successfully Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 23 00:38:58 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Image download 0.00 MB at 0.00 MB/s Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89f8438-ea13-4cb5-b937-4ac4c7c5cee6]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:58 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" returned: 0 in 0.530s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:58 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f Sep 23 00:38:58 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:58 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD Sep 23 00:38:58 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:58 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" returned: 0 in 0.329s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-f7d1ab22-10f9-4b24-b0ac-64a201f9688f" released by "delete_volume" :: held 0.960s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:59 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Created reservations ['7f02cb32-4c44-4d33-a99c-eb799d44dd97', '8c1e41fc-9277-443e-8c64-58986d52873c', '927e5aa1-3ed6-477a-8368-f315c287ce6e', 'e259d60b-f52e-4a1e-ad8f-3d50a4361200', 'cb2f1699-720c-4898-b0a0-7c1a04ff52d5'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:38:59 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD Sep 23 00:38:59 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:59 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:38:59 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:38:59 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD" returned: 1 in 0.548s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Temporary image 2588182b-d83e-45c5-9b5b-050d83ec4eba is fetched for user a385d7871bf443dcbc0e107fc8d4d787. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 23 00:38:59 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.308s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:38:59 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Deleted volume successfully. Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d2713d81-9ffe-482b-9745-c2bcb3206ef5 tempest-ProjectMemberTests-665542472 None] Lock "cinder-f7d1ab22-10f9-4b24-b0ac-64a201f9688f-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ff91e2-9fcc-4f65-8bbb-84f3c7846c78]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:38:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:38:59 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD Sep 23 00:38:59 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (93f4133b-7384-459a-9035-8ab1aff6e26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce729c0a-3d31-4f81-9047-b56bbf71b4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce729c0a-3d31-4f81-9047-b56bbf71b4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1572704776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb558a18-c3de-4126-ad5d-15ec651b270b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:00Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adbca16-3139-44c0-820e-4f457fff590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adbca16-3139-44c0-820e-4f457fff590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8a6d99-f65a-4bdd-94e7-8995a8dacf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8a6d99-f65a-4bdd-94e7-8995a8dacf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb558a18-c3de-4126-ad5d-15ec651b270b', 'volume_name': 'volume-eb558a18-c3de-4126-ad5d-15ec651b270b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a510c287-516b-4cfb-a2fb-83f6d5e54104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a510c287-516b-4cfb-a2fb-83f6d5e54104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e252a61a-ca8f-40ae-8812-89a33f8e718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume eb558a18-c3de-4126-ad5d-15ec651b270b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb558a18-c3de-4126-ad5d-15ec651b270b', 'volume_size': 1} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1572704776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb558a18-c3de-4126-ad5d-15ec651b270b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:00Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Creating volume eb558a18-c3de-4126-ad5d-15ec651b270b {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:00 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:00 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:00 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b 1073741824 Sep 23 00:39:00 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:00 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD Sep 23 00:39:00 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (5b54b873-2923-4fda-bf6a-e814c575035b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb2e9f8-704b-4c76-aa8b-1f4cc2aad8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb2e9f8-704b-4c76-aa8b-1f4cc2aad8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-192698328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:00Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc129b83-2db2-4601-a735-6dc60426110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc129b83-2db2-4601-a735-6dc60426110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d98eef-8b54-459c-9a6b-10a4ba3bb935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d98eef-8b54-459c-9a6b-10a4ba3bb935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e', 'volume_name': 'volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7b04f4-3f79-460e-a904-adbec5ff7a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7b04f4-3f79-460e-a904-adbec5ff7a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b4ec16-2c5b-40d5-ba06-e9e98b035ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:00 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e', 'volume_size': 1} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:00 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD" returned: 1 in 0.489s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:00 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b 1073741824" returned: 0 in 0.628s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:00 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b Sep 23 00:39:00 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (00c6632a-b734-4f2b-b61f-9a0a41edcee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603ed412-fbd2-40d5-b68a-19b75d836e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603ed412-fbd2-40d5-b68a-19b75d836e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-250146811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2647f06d-3863-4818-8ac3-ff95c4077353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:01Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2930c363-b5b0-4f7e-9655-82147f1af2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2930c363-b5b0-4f7e-9655-82147f1af2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c01c67-ecdf-4c90-a79c-b90944d8bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c01c67-ecdf-4c90-a79c-b90944d8bcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2647f06d-3863-4818-8ac3-ff95c4077353', 'volume_name': 'volume-2647f06d-3863-4818-8ac3-ff95c4077353', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5d4c8f-164c-4b59-96a0-4db7b128fbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5d4c8f-164c-4b59-96a0-4db7b128fbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a7c4ab-8723-42f6-85c1-a52767dc96b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume 2647f06d-3863-4818-8ac3-ff95c4077353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2647f06d-3863-4818-8ac3-ff95c4077353', 'volume_size': 1} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:01 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b" returned: 0 in 0.404s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-192698328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:00Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Creating volume c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:01 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e252a61a-ca8f-40ae-8812-89a33f8e718e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb558a18-c3de-4126-ad5d-15ec651b270b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8038608b-d5c5-4b0c-9fc9-06fb725ed9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e 1073741824 Sep 23 00:39:01 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:01 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume volume-eb558a18-c3de-4126-ad5d-15ec651b270b (eb558a18-c3de-4126-ad5d-15ec651b270b): created successfully Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8038608b-d5c5-4b0c-9fc9-06fb725ed9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (93f4133b-7384-459a-9035-8ab1aff6e26d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c57862c3-9a48-4b02-93b5-80108457f24f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created volume successfully. Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (6e51a57e-e89c-4ba8-9fe5-170949ad6d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bbe554-6624-49ab-bed0-4b4f464ed5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bbe554-6624-49ab-bed0-4b4f464ed5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610939196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2571f3-aa90-443b-b011-a46ddc664e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:02Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ade974-49b3-461a-b46d-dc40730868d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1ade974-49b3-461a-b46d-dc40730868d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd96297-5920-4047-ae64-166382f0d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd96297-5920-4047-ae64-166382f0d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2571f3-aa90-443b-b011-a46ddc664e96', 'volume_name': 'volume-de2571f3-aa90-443b-b011-a46ddc664e96', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5737af-a2a8-4dd0-abb6-12718a3a150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db5737af-a2a8-4dd0-abb6-12718a3a150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b7977e-5ba6-4072-91df-95f70b20c938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:01 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Volume de2571f3-aa90-443b-b011-a46ddc664e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2571f3-aa90-443b-b011-a46ddc664e96', 'volume_size': 1} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:01 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e 1073741824" returned: 0 in 0.621s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:02 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e Sep 23 00:39:02 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (bdd9922e-cce9-4a6d-aae4-c5c845909dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8168c852-ba56-4136-a072-c6d0b7ac9c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8168c852-ba56-4136-a072-c6d0b7ac9c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1659951464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ae1542-38fd-49f9-97b9-f8056028545d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:02Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8ae052-3cbd-4f7b-95bb-8b486b1d8b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8ae052-3cbd-4f7b-95bb-8b486b1d8b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f88131-c9e8-4a46-87f4-0bd85f823b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f88131-c9e8-4a46-87f4-0bd85f823b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ae1542-38fd-49f9-97b9-f8056028545d', 'volume_name': 'volume-73ae1542-38fd-49f9-97b9-f8056028545d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517d57e5-bac4-436e-8922-2d0e156150b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517d57e5-bac4-436e-8922-2d0e156150b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12395fb-d3d6-448e-a6c8-4ebe440a1332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume 73ae1542-38fd-49f9-97b9-f8056028545d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ae1542-38fd-49f9-97b9-f8056028545d', 'volume_size': 1} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (15c00a1c-6a09-4c4f-8666-32f6e2f474e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b5b929-2a1e-4e6c-bc78-483e48ffab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b5b929-2a1e-4e6c-bc78-483e48ffab6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-952831803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31ff523-f54a-4c08-a1fe-7501e07bca7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:02Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdff639d-27a2-481f-bbb8-8f0ffddfca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdff639d-27a2-481f-bbb8-8f0ffddfca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96ed840-ff4b-4834-be7e-b527227e54ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96ed840-ff4b-4834-be7e-b527227e54ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31ff523-f54a-4c08-a1fe-7501e07bca7c', 'volume_name': 'volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16363445-f56a-49ee-b458-dc9c4131f1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16363445-f56a-49ee-b458-dc9c4131f1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e760065a-47df-41c4-85cf-c864457e3004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume e31ff523-f54a-4c08-a1fe-7501e07bca7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c', 'volume_size': 1} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:02 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e" returned: 0 in 0.325s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.580s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798daa6b-79d3-4581-a926-01ff273e3691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc8fc45ab92842ab9e31d92efbbdaebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:38:58Z,use_quota=True,user_id='a385d7871bf443dcbc0e107fc8d4d787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Creating volume 798daa6b-79d3-4581-a926-01ff273e3691 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:02 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b4ec16-2c5b-40d5-ba06-e9e98b035ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36054608-ee77-4ae2-9c33-eceb77e0e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:02 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 1073741824 Sep 23 00:39:02 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:02 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e (c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e): created successfully Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36054608-ee77-4ae2-9c33-eceb77e0e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (5b54b873-2923-4fda-bf6a-e814c575035b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:02 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-de48b6c0-3754-450a-a1ab-67c3cff89c53 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created volume successfully. Sep 23 00:39:02 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 1073741824" returned: 0 in 0.463s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:02 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 Sep 23 00:39:02 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:02 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:02 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:03 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691" returned: 0 in 0.276s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-250146811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2647f06d-3863-4818-8ac3-ff95c4077353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:01Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Creating volume 2647f06d-3863-4818-8ac3-ff95c4077353 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:03 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:03 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.312s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:03 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353 1073741824 Sep 23 00:39:03 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Attempting download of 2588182b-d83e-45c5-9b5b-050d83ec4eba ((None, [{'url': 'file:///opt/stack/data/glance/images/2588182b-d83e-45c5-9b5b-050d83ec4eba', 'metadata': {}}])) to volume 798daa6b-79d3-4581-a926-01ff273e3691. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9121eaf2-b60b-4fc5-8f4c-49501d787f0c]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2588182b-d83e-45c5-9b5b-050d83ec4eba_d9bkb1x_ {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:03 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2588182b-d83e-45c5-9b5b-050d83ec4eba_d9bkb1x_ Sep 23 00:39:03 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:03 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2588182b-d83e-45c5-9b5b-050d83ec4eba_d9bkb1x_" returned: 0 in 0.383s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2588182b-d83e-45c5-9b5b-050d83ec4eba_d9bkb1x_ {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:03 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353 1073741824" returned: 0 in 0.511s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:03 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353 Sep 23 00:39:03 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:03 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2588182b-d83e-45c5-9b5b-050d83ec4eba_d9bkb1x_ Sep 23 00:39:03 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:03 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2588182b-d83e-45c5-9b5b-050d83ec4eba_d9bkb1x_" returned: 1 in 0.361s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2588182b-d83e-45c5-9b5b-050d83ec4eba_d9bkb1x_' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a58d038-0bad-4992-931d-05ddf1f4abc9]: (4, 'raw') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:03 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353" returned: 0 in 0.308s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.325s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-610939196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2571f3-aa90-443b-b011-a46ddc664e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:02Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Creating volume de2571f3-aa90-443b-b011-a46ddc664e96 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:04 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a7c4ab-8723-42f6-85c1-a52767dc96b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2647f06d-3863-4818-8ac3-ff95c4077353', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa2b8e7-4f31-4c30-86f4-13d9731ce5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:04 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 1073741824 Sep 23 00:39:04 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:04 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume volume-2647f06d-3863-4818-8ac3-ff95c4077353 (2647f06d-3863-4818-8ac3-ff95c4077353): created successfully Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa2b8e7-4f31-4c30-86f4-13d9731ce5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (00c6632a-b734-4f2b-b61f-9a0a41edcee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:04 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4e99fffa-820a-4706-b71e-d832cec29f77 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created volume successfully. Sep 23 00:39:04 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD Sep 23 00:39:04 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:04 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD" returned: 0 in 0.513s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:04 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD Sep 23 00:39:04 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:04 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 1073741824" returned: 0 in 0.638s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:04 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 Sep 23 00:39:04 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:04 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] 2588182b-d83e-45c5-9b5b-050d83ec4eba was raw, converting to qcow2 {{(pid=87138) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:04 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 Sep 23 00:39:04 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:04 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96" returned: 0 in 0.269s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.812s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1659951464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ae1542-38fd-49f9-97b9-f8056028545d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:02Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Creating volume 73ae1542-38fd-49f9-97b9-f8056028545d {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:04 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b7977e-5ba6-4072-91df-95f70b20c938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2571f3-aa90-443b-b011-a46ddc664e96', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:05 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d 1073741824 Sep 23 00:39:05 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b9ff0e-d650-469a-b6e6-1b738f0ea33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:05 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Volume volume-de2571f3-aa90-443b-b011-a46ddc664e96 (de2571f3-aa90-443b-b011-a46ddc664e96): created successfully Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b9ff0e-d650-469a-b6e6-1b738f0ea33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (6e51a57e-e89c-4ba8-9fe5-170949ad6d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:05 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-379d377b-7922-48ce-a76d-96516e92e69a tempest-ProjectMemberTests-665542472 None] Created volume successfully. Sep 23 00:39:05 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691" returned: 0 in 0.576s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2588182b-d83e-45c5-9b5b-050d83ec4eba_r796vkiedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:39:05 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Converted 0.00 MB image at 0.00 MB/s Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:05 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 1G Sep 23 00:39:05 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:05 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d 1073741824" returned: 0 in 0.526s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:05 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d Sep 23 00:39:05 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:05 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d" returned: 0 in 0.383s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.684s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-952831803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31ff523-f54a-4c08-a1fe-7501e07bca7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cafcb15fa314a2a92a12058b118f585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:02Z,use_quota=True,user_id='e932674a5b6b486680af5c39d7910ac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Creating volume e31ff523-f54a-4c08-a1fe-7501e07bca7c {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:05 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:05 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 1G" returned: 0 in 0.528s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Downloaded image 2588182b-d83e-45c5-9b5b-050d83ec4eba ((None, [{'url': 'file:///opt/stack/data/glance/images/2588182b-d83e-45c5-9b5b-050d83ec4eba', 'metadata': {}}])) to volume 798daa6b-79d3-4581-a926-01ff273e3691 successfully. {{(pid=87138) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Temporary image 2588182b-d83e-45c5-9b5b-050d83ec4eba for user a385d7871bf443dcbc0e107fc8d4d787 is deleted. {{(pid=87138) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.volume_utils [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Marking volume 798daa6b-79d3-4581-a926-01ff273e3691 as bootable. {{(pid=87138) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12395fb-d3d6-448e-a6c8-4ebe440a1332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ae1542-38fd-49f9-97b9-f8056028545d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:05 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c 1073741824 Sep 23 00:39:05 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:05 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644d9b1f-99fe-4afc-9c35-8bb908310af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Copying metadata from image 2588182b-d83e-45c5-9b5b-050d83ec4eba to 798daa6b-79d3-4581-a926-01ff273e3691. {{(pid=87138) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Creating volume glance metadata for volume 798daa6b-79d3-4581-a926-01ff273e3691 backed by image 2588182b-d83e-45c5-9b5b-050d83ec4eba with: {'image_id': '2588182b-d83e-45c5-9b5b-050d83ec4eba', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ce17d5af30b9b10e7854cd8c95688818', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87138) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 23 00:39:06 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume volume-73ae1542-38fd-49f9-97b9-f8056028545d (73ae1542-38fd-49f9-97b9-f8056028545d): created successfully Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644d9b1f-99fe-4afc-9c35-8bb908310af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (bdd9922e-cce9-4a6d-aae4-c5c845909dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-cbf890a6-8afa-42ea-87a1-3b803c48dc3c tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created volume successfully. Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e04dc35-6b58-4320-b434-a3999c9226cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798daa6b-79d3-4581-a926-01ff273e3691', 'volume_size': 1, 'image_id': '2588182b-d83e-45c5-9b5b-050d83ec4eba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2588182b-d83e-45c5-9b5b-050d83ec4eba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ce17d5af30b9b10e7854cd8c95688818', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bc8fc45ab92842ab9e31d92efbbdaebd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8b2457db2d2c10eb1bf9c870dc4e1f8a00ae1eb07dd716c8d09a25acb4b4934c8a19f9376ae9ea1a8e81bb32c0531903073335d7a5393a82ebdb6c07edc92b0e', 'id': '2588182b-d83e-45c5-9b5b-050d83ec4eba', 'created_at': datetime.datetime(2026, 9, 22, 22, 38, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 22, 22, 38, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2588182b-d83e-45c5-9b5b-050d83ec4eba/file', 'properties': {}}, 'image_service': }' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718d3913-0cb8-4483-9258-4615abcdd173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:06 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Volume volume-798daa6b-79d3-4581-a926-01ff273e3691 (798daa6b-79d3-4581-a926-01ff273e3691): created successfully Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718d3913-0cb8-4483-9258-4615abcdd173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Flow 'volume_create_manager' (92f2986e-3bc7-4a7f-a487-8203de71645b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8fdb7de1-86f4-4299-a4c4-d504471a6894 tempest-VolumeImageDependencyTests-523434990 None] Created volume successfully. Sep 23 00:39:06 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c 1073741824" returned: 0 in 0.486s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:06 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c Sep 23 00:39:06 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:06 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c" returned: 0 in 0.269s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.879s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e760065a-47df-41c4-85cf-c864457e3004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b98aed-b9af-45a9-8ce1-64343f92eedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Creating offline snapshot b18057b4-96ec-49a8-a8f6-3178c02c0db5 of volume de2571f3-aa90-443b-b011-a46ddc664e96 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:06 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Volume volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c (e31ff523-f54a-4c08-a1fe-7501e07bca7c): created successfully Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b98aed-b9af-45a9-8ce1-64343f92eedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Flow 'volume_create_manager' (15c00a1c-6a09-4c4f-8666-32f6e2f474e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2fcd95-531e-4d95-b1f8-5b3dd43bd9f5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e0d729c0-d622-4306-b5b9-48c43987d31f tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created volume successfully. Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Acquiring lock "cinder-798daa6b-79d3-4581-a926-01ff273e3691-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Lock "cinder-798daa6b-79d3-4581-a926-01ff273e3691-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Acquiring lock "cinder-quobyte-798daa6b-79d3-4581-a926-01ff273e3691" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:07 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 Sep 23 00:39:07 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Lock "cinder-quobyte-798daa6b-79d3-4581-a926-01ff273e3691" acquired by "delete_volume" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6df8eda-4ec6-4968-8015-b114b2c947c5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:07 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 Sep 23 00:39:07 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (c97cda5c-695d-4717-862a-be6038f61b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30de59ed-ad29-432d-b9ab-e4bcb93b59cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:07 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30de59ed-ad29-432d-b9ab-e4bcb93b59cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-726846354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97b5977-5524-4355-8f05-b4d17bc2e311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:07Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8604b20-445c-428f-a00c-50716b4e8d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8604b20-445c-428f-a00c-50716b4e8d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b23af67-908b-4509-b300-459ef53dabdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b23af67-908b-4509-b300-459ef53dabdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97b5977-5524-4355-8f05-b4d17bc2e311', 'volume_name': 'volume-e97b5977-5524-4355-8f05-b4d17bc2e311', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae20dfd5-0255-4f7d-afaf-4a366091ffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae20dfd5-0255-4f7d-afaf-4a366091ffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69768c17-fee3-4ec2-8642-c6b907564338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:07 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Volume e97b5977-5524-4355-8f05-b4d17bc2e311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97b5977-5524-4355-8f05-b4d17bc2e311', 'volume_size': 1} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96" returned: 0 in 0.521s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:07 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 1G Sep 23 00:39:07 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:07 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691" returned: 0 in 0.393s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:07 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691 Sep 23 00:39:07 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-e31ff523-f54a-4c08-a1fe-7501e07bca7c-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-e31ff523-f54a-4c08-a1fe-7501e07bca7c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-quobyte-e31ff523-f54a-4c08-a1fe-7501e07bca7c" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:07 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-e31ff523-f54a-4c08-a1fe-7501e07bca7c" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-798daa6b-79d3-4581-a926-01ff273e3691" returned: 0 in 0.326s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Lock "cinder-quobyte-798daa6b-79d3-4581-a926-01ff273e3691" released by "delete_volume" :: held 0.798s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff355914-849d-4ea4-bc25-b821bce3dbf3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:07 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 1G" returned: 0 in 0.495s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de2571f3-aa90-443b-b011-a46ddc664e96 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:07 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de2571f3-aa90-443b-b011-a46ddc664e96 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 Sep 23 00:39:07 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Created reservations ['69a4d8b2-6ed1-4b61-ac67-8137a61d6bbc', '626eb523-4624-4c9c-84ec-96859fa6168a', '02cb9e55-65f0-44e6-8e09-0e870c079899', '3358e722-71e3-43f0-a182-babb9e5beb22', 'bf5775cb-dcf1-4a71-b8ad-809dbda94ee4'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:07 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c Sep 23 00:39:07 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:08 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:08 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:08 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de2571f3-aa90-443b-b011-a46ddc664e96 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5" returned: 0 in 0.389s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:08 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 is being set with open permissions: ugo+rw Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:08 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 Sep 23 00:39:08 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:08 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c" returned: 0 in 0.484s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:08 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c Sep 23 00:39:08 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:08 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.363s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Deleted volume successfully. Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b493b13d-a029-4d4a-ac83-ee72a36d4658 tempest-VolumeImageDependencyTests-523434990 None] Lock "cinder-798daa6b-79d3-4581-a926-01ff273e3691-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:08 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5" returned: 0 in 0.289s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:08 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.info Sep 23 00:39:08 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:08 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e31ff523-f54a-4c08-a1fe-7501e07bca7c" returned: 0 in 0.304s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-e31ff523-f54a-4c08-a1fe-7501e07bca7c" released by "delete_volume" :: held 0.842s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created reservations ['2cd06b28-eaf9-4c4e-a2a1-5dcc9a01ce5a', '298eb53f-e175-4628-89fc-8004e6c53438', '34479cfc-a85f-400c-a57b-9fc6e2539097', '8cdb5256-e73a-4d6e-ac19-828a6efdb1c2', '74cb7b68-f70e-49fb-9ada-f1a8a3e82102'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:08 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:08 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-73ae1542-38fd-49f9-97b9-f8056028545d-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:08 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.info" returned: 0 in 0.357s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:08 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.info is being set with open permissions: ugo+rw Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:08 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-73ae1542-38fd-49f9-97b9-f8056028545d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:08 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.info Sep 23 00:39:08 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-quobyte-73ae1542-38fd-49f9-97b9-f8056028545d" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-73ae1542-38fd-49f9-97b9-f8056028545d" acquired by "delete_volume" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb93395-2f2b-44c1-a891-2dd224bdf3d6]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:09 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.385s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Deleted volume successfully. Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-81c6b7fd-72b8-4320-86bf-eb871122e459 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-e31ff523-f54a-4c08-a1fe-7501e07bca7c-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:09 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d Sep 23 00:39:09 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:09 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.info" returned: 0 in 0.362s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.954s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-726846354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97b5977-5524-4355-8f05-b4d17bc2e311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:07Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Creating volume e97b5977-5524-4355-8f05-b4d17bc2e311 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:09 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:09 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 1073741824 Sep 23 00:39:09 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:09 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8fcaddde-0369-474c-be15-a200f6437879 tempest-ProjectMemberTests-665542472 None] Create snapshot completed successfully Sep 23 00:39:09 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d" returned: 0 in 0.487s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:09 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d Sep 23 00:39:09 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:09 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-73ae1542-38fd-49f9-97b9-f8056028545d" returned: 0 in 0.271s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-73ae1542-38fd-49f9-97b9-f8056028545d" released by "delete_volume" :: held 0.828s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:09 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 1073741824" returned: 0 in 0.570s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created reservations ['bac321f1-5de3-4988-afd9-5b8564714829', 'c3156750-e5fa-43a6-8fef-ce6af3bd90a1', '137e78d9-1646-461f-b256-4c97df935d82', '7a8574f4-fbea-49a4-8882-da65424c2e43', 'b6bd708f-4534-4fe4-96fd-f4a118be6bc6'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:09 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 Sep 23 00:39:09 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:10 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:10 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-2647f06d-3863-4818-8ac3-ff95c4077353-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-2647f06d-3863-4818-8ac3-ff95c4077353-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-b18057b4-96ec-49a8-a8f6-3178c02c0db5-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-quobyte-2647f06d-3863-4818-8ac3-ff95c4077353" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Lock "cinder-b18057b4-96ec-49a8-a8f6-3178c02c0db5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-de2571f3-aa90-443b-b011-a46ddc664e96" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:10 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-2647f06d-3863-4818-8ac3-ff95c4077353" acquired by "delete_volume" :: waited 0.060s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311" returned: 0 in 0.445s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-de2571f3-aa90-443b-b011-a46ddc664e96" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-b18057b4-96ec-49a8-a8f6-3178c02c0db5" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a8e36c-e8eb-47f1-938f-d628532583e3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69768c17-fee3-4ec2-8642-c6b907564338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97b5977-5524-4355-8f05-b4d17bc2e311', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c65438f-19aa-4d71-9bbf-3737d21aa5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-b18057b4-96ec-49a8-a8f6-3178c02c0db5" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Deleting offline snapshot b18057b4-96ec-49a8-a8f6-3178c02c0db5 of volume de2571f3-aa90-443b-b011-a46ddc664e96 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] snapshot_file for this snap is: volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:10 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Volume volume-e97b5977-5524-4355-8f05-b4d17bc2e311 (e97b5977-5524-4355-8f05-b4d17bc2e311): created successfully Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c65438f-19aa-4d71-9bbf-3737d21aa5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:10 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (c97cda5c-695d-4717-862a-be6038f61b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f18df1-e8f0-452c-8f1c-7d7dac2ff6c6]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.513s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3af50885-65a5-404f-ad6d-43f42d4bfae4 tempest-ProjectReaderTests-618562035 None] Created volume successfully. Sep 23 00:39:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Deleted volume successfully. Sep 23 00:39:10 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353 Sep 23 00:39:10 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-dc8296b0-c6c6-46f7-8b57-65915a9050c6 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-73ae1542-38fd-49f9-97b9-f8056028545d-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:10 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 Sep 23 00:39:10 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:10 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353" returned: 0 in 0.481s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:10 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353 Sep 23 00:39:10 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:11 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5" returned: 0 in 0.458s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de2571f3-aa90-443b-b011-a46ddc664e96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a926458d-b51f-4060-8553-222c505ebbfd]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:11 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2647f06d-3863-4818-8ac3-ff95c4077353" returned: 0 in 0.275s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:11 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 Sep 23 00:39:11 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-2647f06d-3863-4818-8ac3-ff95c4077353" released by "delete_volume" :: held 0.836s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created reservations ['58d2c0d8-af5c-41d5-a675-3883cc6d5f27', '4ff47b5c-11ec-4df6-88a0-b1eebdb223bc', 'de457bce-f644-4176-9deb-7a801d8c093f', '16f6375d-353f-44ac-8bf7-54c5d054990a', '18f9797b-e038-4484-9c9d-1ee875144ad9'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:11 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:11 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:11 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96" returned: 0 in 0.443s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:11 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 Sep 23 00:39:11 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:11 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.363s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:11 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Deleted volume successfully. Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Creating offline snapshot f4db162a-fd13-40b5-8ad1-6696118c8167 of volume e97b5977-5524-4355-8f05-b4d17bc2e311 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-83b22490-ce5c-458c-8d1e-928ae5108899 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-2647f06d-3863-4818-8ac3-ff95c4077353-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f742b773-598d-43c3-927a-a15a53fcd59f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:11 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5" returned: 0 in 0.418s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:11 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5 Sep 23 00:39:11 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:11 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 Sep 23 00:39:11 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:12 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96.b18057b4-96ec-49a8-a8f6-3178c02c0db5" returned: 0 in 0.313s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-b18057b4-96ec-49a8-a8f6-3178c02c0db5" released by "_delete_snapshot" :: held 1.835s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:12 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311" returned: 0 in 0.474s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-de2571f3-aa90-443b-b011-a46ddc664e96" released by "delete_snapshot" :: held 1.919s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:12 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 1G Sep 23 00:39:12 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Flow 'volume_create_manager' (6fe826e0-b923-4643-8852-fe9360799af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f97b9b0-9d8f-4bec-ac56-bba2e523e714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Created reservations ['4e9c34a0-5f7c-4370-a685-2a5d411e995b', '03313d4c-d17e-4f4f-9c0f-1b045cd61266', '54bda399-2e2f-4410-a337-f33b58f60554', 'd3bc1c33-ed0e-4a49-9c29-e1db711cc231', 'b8ed7221-87b0-4ad4-b9b8-8fe2c937133f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f97b9b0-9d8f-4bec-ac56-bba2e523e714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4631c27f-81e0-4ea3-8c38-ff60a8d133df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71f63679ed54875ba9576995134daa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:12Z,use_quota=True,user_id='3efd6cd3f71348fd804cfa85467828aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1c8e08-1bf0-4b34-bf08-b4b2c21bed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db1c8e08-1bf0-4b34-bf08-b4b2c21bed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f646e549-1afe-431d-82f5-55261a427927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f646e549-1afe-431d-82f5-55261a427927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4631c27f-81e0-4ea3-8c38-ff60a8d133df', 'volume_name': 'volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30596e6b-0430-4fef-9954-ebfe6e064ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30596e6b-0430-4fef-9954-ebfe6e064ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691fe1a2-52af-40f7-893a-e5d1eff1cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:12 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Volume 4631c27f-81e0-4ea3-8c38-ff60a8d133df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df', 'volume_size': 1} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-quobyte-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:12 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Delete snapshot completed successfully. Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[0480c2d2-c661-4fa9-af9c-93f11bed657d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2c3c5bf3-d958-4c47-ba72-0711f867e104 tempest-ProjectMemberTests-665542472 None] Lock "cinder-b18057b4-96ec-49a8-a8f6-3178c02c0db5-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:12 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e Sep 23 00:39:12 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:12 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 1G" returned: 0 in 0.518s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97b5977-5524-4355-8f05-b4d17bc2e311 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:12 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97b5977-5524-4355-8f05-b4d17bc2e311 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 Sep 23 00:39:12 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:13 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e" returned: 0 in 0.399s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:13 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e Sep 23 00:39:13 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:13 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97b5977-5524-4355-8f05-b4d17bc2e311 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167" returned: 0 in 0.329s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:13 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 is being set with open permissions: ugo+rw Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:13 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 Sep 23 00:39:13 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:13 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e" returned: 0 in 0.281s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e" released by "delete_volume" :: held 0.732s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created reservations ['6e18a57b-a7e7-4f53-bf1f-eb1f600045fd', '9ceda181-8939-4355-b516-dcd70f18d309', 'b012ce65-dd11-4b7a-883a-16dddef601ab', '7aa4449e-5c66-40a8-9529-1b4103ad0ea6', '93071877-61ac-4a31-b337-15b60f884c2a'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:13 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167" returned: 0 in 0.280s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:13 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.info Sep 23 00:39:13 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:13 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:13 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-de2571f3-aa90-443b-b011-a46ddc664e96-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Lock "cinder-de2571f3-aa90-443b-b011-a46ddc664e96-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-eb558a18-c3de-4126-ad5d-15ec651b270b-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-eb558a18-c3de-4126-ad5d-15ec651b270b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-de2571f3-aa90-443b-b011-a46ddc664e96" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-de2571f3-aa90-443b-b011-a46ddc664e96" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:13 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-quobyte-eb558a18-c3de-4126-ad5d-15ec651b270b" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.info" returned: 0 in 0.357s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:13 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.info is being set with open permissions: ugo+rw Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1524eb9-40b2-4785-9bb3-5fc5da44ed44]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:13 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.info Sep 23 00:39:13 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-eb558a18-c3de-4126-ad5d-15ec651b270b" acquired by "delete_volume" :: waited 0.042s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46f003b-2edc-41c4-8858-515d0b28e619]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:13 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.397s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:13 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Deleted volume successfully. Sep 23 00:39:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a84bbef-cb16-4735-b637-efa3c8fe66c8 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-c59a2d8f-aa1a-4720-b4ae-6eeacc5ed32e-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:14 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 Sep 23 00:39:14 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:14 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b Sep 23 00:39:14 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:14 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.info" returned: 0 in 0.263s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4631c27f-81e0-4ea3-8c38-ff60a8d133df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71f63679ed54875ba9576995134daa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:12Z,use_quota=True,user_id='3efd6cd3f71348fd804cfa85467828aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Creating volume 4631c27f-81e0-4ea3-8c38-ff60a8d133df {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:14 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:14 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df 1073741824 Sep 23 00:39:14 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:14 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d211ce25-54b2-4ccf-a072-626792f14471 tempest-ProjectReaderTests-618562035 None] Create snapshot completed successfully Sep 23 00:39:14 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96" returned: 0 in 0.468s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:14 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b" returned: 0 in 0.438s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:14 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96 Sep 23 00:39:14 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:14 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b Sep 23 00:39:14 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:14 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-de2571f3-aa90-443b-b011-a46ddc664e96" returned: 0 in 0.304s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:14 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:14 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-eb558a18-c3de-4126-ad5d-15ec651b270b" returned: 0 in 0.303s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-de2571f3-aa90-443b-b011-a46ddc664e96" released by "delete_volume" :: held 0.874s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df 1073741824" returned: 0 in 0.535s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-eb558a18-c3de-4126-ad5d-15ec651b270b" released by "delete_volume" :: held 0.802s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:14 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df Sep 23 00:39:14 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created reservations ['16abc4b6-5052-4afa-83fa-56a947a8b819', '1f71c571-d6b6-4b29-9563-45021afbbc6b', '4f35c318-0363-46ac-8588-9e1ad8a3da87', '1cfee571-6da3-4769-ba4e-95c82e947c03', '3641a1da-2ac8-41e5-9101-9dfa1f90d89c'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Created reservations ['23727191-dc02-4d23-a51d-9b6803aa9e50', 'e203fe38-985e-4182-84a8-b6e5cb7a5322', 'e82e6bf0-2dd5-42c5-8222-bd13a285d202', '93cef799-f645-4acc-a1af-2289afc54700', '83484b2e-e492-4bc3-9e9f-bf401cd892de'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:14 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:14 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:15 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:15 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:15 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df" returned: 0 in 0.349s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691fe1a2-52af-40f7-893a-e5d1eff1cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7effe46e-4313-4f09-87e4-a8188f341e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:15 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Volume volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df (4631c27f-81e0-4ea3-8c38-ff60a8d133df): created successfully Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7effe46e-4313-4f09-87e4-a8188f341e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Flow 'volume_create_manager' (6fe826e0-b923-4643-8852-fe9360799af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:15 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5ed76fa8-1db5-4a1c-8ff0-3fca78ece1c9 tempest-CinderUnicodeTest-605661430 None] Created volume successfully. Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-f4db162a-fd13-40b5-8ad1-6696118c8167-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Lock "cinder-f4db162a-fd13-40b5-8ad1-6696118c8167-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-e97b5977-5524-4355-8f05-b4d17bc2e311" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-e97b5977-5524-4355-8f05-b4d17bc2e311" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-f4db162a-fd13-40b5-8ad1-6696118c8167" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-f4db162a-fd13-40b5-8ad1-6696118c8167" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Deleting offline snapshot f4db162a-fd13-40b5-8ad1-6696118c8167 of volume e97b5977-5524-4355-8f05-b4d17bc2e311 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:15 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] snapshot_file for this snap is: volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.372s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:15 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Deleted volume successfully. Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[da74d9d4-b193-4e14-a6da-5e7fbeaf38a1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d30ed288-eed0-4574-8c6d-a603b9528830 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-eb558a18-c3de-4126-ad5d-15ec651b270b-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:15 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.361s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:15 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Deleted volume successfully. Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8f4f6246-8554-4896-890e-a1b0aaed6f12 tempest-ProjectMemberTests-665542472 None] Lock "cinder-de2571f3-aa90-443b-b011-a46ddc664e96-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:15 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 Sep 23 00:39:15 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:15 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167" returned: 0 in 0.416s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e97b5977-5524-4355-8f05-b4d17bc2e311(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[caec65fb-ff2c-4c1a-b448-9cb1a6d5fbf5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:15 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 Sep 23 00:39:15 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-275ac186-1a37-4366-ac25-82514e17c577-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-275ac186-1a37-4366-ac25-82514e17c577-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-quobyte-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-quobyte-275ac186-1a37-4366-ac25-82514e17c577" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-275ac186-1a37-4366-ac25-82514e17c577" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Deleting offline snapshot 275ac186-1a37-4366-ac25-82514e17c577 of volume 9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] snapshot_file for this snap is: volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1b0d57-9575-4f39-9a5b-14cdfa9ed76c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:16 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311" returned: 0 in 0.540s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:16 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 Sep 23 00:39:16 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Flow 'volume_create_manager' (5d168bd9-f169-463c-8310-04350d777545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99633ae-efd9-487c-a543-b5898fe92a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 Sep 23 00:39:16 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99633ae-efd9-487c-a543-b5898fe92a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1766085934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947ca13e-79db-4d7e-a8ad-4a913a90cc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71f63679ed54875ba9576995134daa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:16Z,use_quota=True,user_id='3efd6cd3f71348fd804cfa85467828aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c276240-8c8e-4da8-bf08-0cee9c0bfa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c276240-8c8e-4da8-bf08-0cee9c0bfa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4b90f4-ae92-41eb-8766-30c2b67b752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4b90f4-ae92-41eb-8766-30c2b67b752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947ca13e-79db-4d7e-a8ad-4a913a90cc74', 'volume_name': 'volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cbc17d-45f4-4958-8304-1189ee439f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42cbc17d-45f4-4958-8304-1189ee439f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb00752b-5e26-4a18-92bd-71d6eb008af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Volume 947ca13e-79db-4d7e-a8ad-4a913a90cc74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74', 'volume_size': 1} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1766085934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947ca13e-79db-4d7e-a8ad-4a913a90cc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d71f63679ed54875ba9576995134daa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:16Z,use_quota=True,user_id='3efd6cd3f71348fd804cfa85467828aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Creating volume 947ca13e-79db-4d7e-a8ad-4a913a90cc74 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:16 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:16 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 1073741824 Sep 23 00:39:16 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (397f47ac-a8ba-49b0-b903-777f36096d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828ef191-d725-43ca-b83c-077bf3975af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (828ef191-d725-43ca-b83c-077bf3975af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310217138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8368b1-6690-4967-b227-4ec6eea855ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:16Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db904791-dc87-4b26-b0f7-976d046aa713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db904791-dc87-4b26-b0f7-976d046aa713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b08cb1e-d6c4-454e-8698-ee413034ef65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b08cb1e-d6c4-454e-8698-ee413034ef65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8368b1-6690-4967-b227-4ec6eea855ca', 'volume_name': 'volume-dd8368b1-6690-4967-b227-4ec6eea855ca', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86fc272-135f-4921-999e-3ca89e1a1e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b86fc272-135f-4921-999e-3ca89e1a1e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771c3a4e-8eb0-473d-9b7b-85265da53854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:16 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Volume dd8368b1-6690-4967-b227-4ec6eea855ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8368b1-6690-4967-b227-4ec6eea855ca', 'volume_size': 1} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:16 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167" returned: 0 in 0.409s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:16 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577" returned: 0 in 0.450s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:16 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167 Sep 23 00:39:16 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[869fe43d-077e-425c-8474-b566ca43e89b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:16 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 Sep 23 00:39:16 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:16 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311.f4db162a-fd13-40b5-8ad1-6696118c8167" returned: 0 in 0.273s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:16 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 1073741824" returned: 0 in 0.510s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-f4db162a-fd13-40b5-8ad1-6696118c8167" released by "_delete_snapshot" :: held 1.767s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-e97b5977-5524-4355-8f05-b4d17bc2e311" released by "delete_snapshot" :: held 1.816s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:17 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 Sep 23 00:39:17 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Created reservations ['dfec3815-4a9f-41cf-9454-e71be7429774', '5dd8a541-64c2-4e56-9ac3-3b18ba417f0e', '6cbfc7e3-b2bc-4b5e-ae26-4de6670894a2', 'edb6712a-dcad-4de6-8ad1-671e79e8e0dd', 'be5315f2-8b25-49d4-99e8-b39a003b4d66'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Delete snapshot completed successfully. Sep 23 00:39:17 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-337667be-887c-4c0a-b3c7-2d3cb0ac7d0f tempest-ProjectReaderTests-618562035 None] Lock "cinder-f4db162a-fd13-40b5-8ad1-6696118c8167-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" returned: 0 in 0.452s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:17 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 Sep 23 00:39:17 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-e97b5977-5524-4355-8f05-b4d17bc2e311-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:17 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74" returned: 0 in 0.311s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Lock "cinder-e97b5977-5524-4355-8f05-b4d17bc2e311-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.745s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-310217138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8368b1-6690-4967-b227-4ec6eea855ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:16Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Creating volume dd8368b1-6690-4967-b227-4ec6eea855ca {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:17 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:17 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca 1073741824 Sep 23 00:39:17 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb00752b-5e26-4a18-92bd-71d6eb008af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e759ef-d526-4e04-b3f8-a304b2b145ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:17 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Volume volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 (947ca13e-79db-4d7e-a8ad-4a913a90cc74): created successfully Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e759ef-d526-4e04-b3f8-a304b2b145ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Flow 'volume_create_manager' (5d168bd9-f169-463c-8310-04350d777545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:17 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-84f3027b-b455-4bb2-89ff-0cb40c37f78f tempest-CinderUnicodeTest-605661430 None] Created volume successfully. Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-e97b5977-5524-4355-8f05-b4d17bc2e311" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-e97b5977-5524-4355-8f05-b4d17bc2e311" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e061ee91-e679-4cfc-befd-7f5d2d3af141]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:17 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577" returned: 0 in 0.414s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:17 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577 Sep 23 00:39:17 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:17 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 Sep 23 00:39:17 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:17 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca 1073741824" returned: 0 in 0.500s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:17 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6.275ac186-1a37-4366-ac25-82514e17c577" returned: 0 in 0.291s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:17 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca Sep 23 00:39:17 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:17 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-275ac186-1a37-4366-ac25-82514e17c577" released by "_delete_snapshot" :: held 1.797s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:18 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" released by "delete_snapshot" :: held 1.844s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311" returned: 0 in 0.438s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:18 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311 Sep 23 00:39:18 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created reservations ['6ad5e93a-a677-451a-ac11-8fbd1017ccc3', '15d58c0c-a4ad-4c16-88d1-26ea5b51ef9b', 'ff3a0fd4-c7f9-4b3f-88ca-26ca7ff6f54a', '6b1b891a-c066-4fc3-ad65-546e150b6d00', 'fd63eaf4-1012-4aa1-9c5f-a4555728e77d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:18 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Delete snapshot completed successfully. Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5e6d9ec8-b4d8-4e6a-bd55-f5bcc527f0af tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-275ac186-1a37-4366-ac25-82514e17c577-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:18 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca" returned: 0 in 0.301s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771c3a4e-8eb0-473d-9b7b-85265da53854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8368b1-6690-4967-b227-4ec6eea855ca', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26ec0f7-8fc0-49c7-aa1e-99ea1fdcec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:18 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Volume volume-dd8368b1-6690-4967-b227-4ec6eea855ca (dd8368b1-6690-4967-b227-4ec6eea855ca): created successfully Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26ec0f7-8fc0-49c7-aa1e-99ea1fdcec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (397f47ac-a8ba-49b0-b903-777f36096d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:18 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e97b5977-5524-4355-8f05-b4d17bc2e311" returned: 0 in 0.307s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:18 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8a9ee248-d12d-4354-a6f4-c0baa523152c tempest-ProjectMemberTests-665542472 None] Created volume successfully. Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-e97b5977-5524-4355-8f05-b4d17bc2e311" released by "delete_volume" :: held 0.834s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "cinder-quobyte-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[de676a2c-6de4-4d75-8aec-a985d5710b63]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Created reservations ['de8e7fbe-2be4-4d10-b201-7a8e5bd4a06c', '5811a151-eb62-4319-9905-be694aad7359', 'ae6cd788-ccc1-4e1c-981e-1e53294ea202', '8b10d3d0-9eb7-43c8-99b2-57305553bb2b', 'f9e9db72-e60f-4b19-b58f-7f20cc81331e'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:18 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 Sep 23 00:39:18 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:18 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:18 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Creating offline snapshot 86884b3f-fd24-42e7-bc45-69d227ca42fa of volume 947ca13e-79db-4d7e-a8ad-4a913a90cc74 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf37e77-3c9f-4532-ad33-1e95ccbe91cf]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:18 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 Sep 23 00:39:18 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:18 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.319s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:18 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Deleted volume successfully. Sep 23 00:39:18 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" returned: 0 in 0.491s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:18 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1091897a-fde7-4c23-8f0d-893d3e8937ad tempest-ProjectReaderTests-618562035 None] Lock "cinder-e97b5977-5524-4355-8f05-b4d17bc2e311-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:19 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6 Sep 23 00:39:19 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:19 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74" returned: 0 in 0.442s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:19 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa 1G Sep 23 00:39:19 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:19 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" returned: 0 in 0.261s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-quobyte-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6" released by "delete_volume" :: held 0.836s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Created reservations ['4aa3c6a3-eb2c-4a52-8702-00dc7360b4c4', '4856df0d-f390-473f-87d3-3300b614a1fb', '90f5d195-c99f-463e-aca4-0177ef59702f', 'a4a310cb-b437-4ce0-aff3-65aba237a157', 'a698971e-59cb-4af3-afba-bf7de3cf44b9'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:19 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:19 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:19 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa 1G" returned: 0 in 0.530s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:19 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.328s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:19 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Deleted volume successfully. Sep 23 00:39:19 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa Sep 23 00:39:19 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8d4a92cc-e7f0-41ae-9c40-77bb943326c5 tempest-CreateVolumesFromSnapshotTest-1864030327 None] Lock "cinder-9c074119-8d16-48d8-8cc9-a3f37ac5d9e6-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:20 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa" returned: 0 in 0.367s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:20 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa is being set with open permissions: ugo+rw Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:20 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa Sep 23 00:39:20 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (d790d257-3403-42aa-aa57-9dc16266cad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fed4aef-ad79-4544-afa7-e8806111377f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fed4aef-ad79-4544-afa7-e8806111377f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511578429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb820b6-3963-43cd-9009-0a1aa881712b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:20Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23417a1-816e-415c-8605-17ff12f57560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23417a1-816e-415c-8605-17ff12f57560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c575abc-495c-4d34-9720-e31929d9016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c575abc-495c-4d34-9720-e31929d9016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fb820b6-3963-43cd-9009-0a1aa881712b', 'volume_name': 'volume-3fb820b6-3963-43cd-9009-0a1aa881712b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28a5204-e603-4f43-8f88-bf4479be9e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28a5204-e603-4f43-8f88-bf4479be9e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b2eb2a-8717-4c9d-995d-45fd2a22eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:20 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Volume 3fb820b6-3963-43cd-9009-0a1aa881712b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fb820b6-3963-43cd-9009-0a1aa881712b', 'volume_size': 1} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:20 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa" returned: 0 in 0.293s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:20 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.info Sep 23 00:39:20 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:20 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.info" returned: 0 in 0.257s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:20 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.info is being set with open permissions: ugo+rw Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:20 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.info Sep 23 00:39:20 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:20 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.info" returned: 0 in 0.273s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.279s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.059s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:20 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Creating offline snapshot 8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 of volume dd8368b1-6690-4967-b227-4ec6eea855ca {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:21 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-fdeb8ed7-79d0-43bc-b562-84ad565673df tempest-CinderUnicodeTest-605661430 None] Create snapshot completed successfully Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=268,cinder:UPDATE=338,cinder:DELETE=34,cinder:INSERT=98 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6a256f-1d33-47cb-b0d3-15305461dbb9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:21 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca Sep 23 00:39:21 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:21 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca" returned: 0 in 0.407s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:21 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 1G Sep 23 00:39:21 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Acquiring lock "cinder-86884b3f-fd24-42e7-bc45-69d227ca42fa-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Lock "cinder-86884b3f-fd24-42e7-bc45-69d227ca42fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:21 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Acquiring lock "cinder-quobyte-947ca13e-79db-4d7e-a8ad-4a913a90cc74" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 1G" returned: 0 in 0.472s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8368b1-6690-4967-b227-4ec6eea855ca -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Lock "cinder-quobyte-947ca13e-79db-4d7e-a8ad-4a913a90cc74" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Acquiring lock "cinder-quobyte-86884b3f-fd24-42e7-bc45-69d227ca42fa" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:21 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8368b1-6690-4967-b227-4ec6eea855ca -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 Sep 23 00:39:21 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Lock "cinder-quobyte-86884b3f-fd24-42e7-bc45-69d227ca42fa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Deleting offline snapshot 86884b3f-fd24-42e7-bc45-69d227ca42fa of volume 947ca13e-79db-4d7e-a8ad-4a913a90cc74 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:21 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] snapshot_file for this snap is: volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[850840b8-c29e-403c-81dd-7e0f858f2888]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:22 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa Sep 23 00:39:22 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:22 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd8368b1-6690-4967-b227-4ec6eea855ca -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0" returned: 0 in 0.360s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:22 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 is being set with open permissions: ugo+rw Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:22 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 Sep 23 00:39:22 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:22 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa" returned: 0 in 0.440s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6296bfbe-e805-461b-9fcc-4e1921888055]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:22 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0" returned: 0 in 0.290s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=348,cinder:SELECT=261,cinder:INSERT=99,cinder:DELETE=23 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:22 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 Sep 23 00:39:22 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:22 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.info Sep 23 00:39:22 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:22 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.info" returned: 0 in 0.302s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:22 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.info is being set with open permissions: ugo+rw Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:22 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74" returned: 0 in 0.413s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:22 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.info Sep 23 00:39:22 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:22 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa Sep 23 00:39:22 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:22 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-27d8fcf9-91f7-4fa7-8a72-c5cb721795c9 tempest-ProjectAdminTests-1678851524 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5189056396484, 'free_capacity_gb': 1775.5189056396484, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87138) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 23 00:39:23 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.info" returned: 0 in 0.303s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.942s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511578429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fb820b6-3963-43cd-9009-0a1aa881712b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:20Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Creating volume 3fb820b6-3963-43cd-9009-0a1aa881712b {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:23 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:23 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b 1073741824 Sep 23 00:39:23 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:23 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-c64b53ff-c242-43ff-9eee-4a1d1c3c9a6d tempest-ProjectMemberTests-665542472 None] Create snapshot completed successfully Sep 23 00:39:23 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa" returned: 0 in 0.428s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:23 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa Sep 23 00:39:23 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:23 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74.86884b3f-fd24-42e7-bc45-69d227ca42fa" returned: 0 in 0.287s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Lock "cinder-quobyte-86884b3f-fd24-42e7-bc45-69d227ca42fa" released by "_delete_snapshot" :: held 1.728s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Lock "cinder-quobyte-947ca13e-79db-4d7e-a8ad-4a913a90cc74" released by "delete_snapshot" :: held 1.754s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Created reservations ['6e97dab2-77bb-47ea-932c-dbeb2fc20501', '2f7bbfdb-f5c0-4f26-bead-47e661843519', 'bfe6d89c-c104-463b-bd8c-55ad1595f37b', 'd928b216-99a5-4201-9401-dfe7f630fb96', '8ea1660d-8a1b-44e4-a2a1-efe18a70ee42'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:23 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b 1073741824" returned: 0 in 0.532s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:23 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Delete snapshot completed successfully. Sep 23 00:39:23 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b Sep 23 00:39:23 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:23 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8b5b7c15-4d1c-4c19-93d6-75cdfae76c4b tempest-CinderUnicodeTest-605661430 None] Lock "cinder-86884b3f-fd24-42e7-bc45-69d227ca42fa-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:24 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Acquiring lock "cinder-947ca13e-79db-4d7e-a8ad-4a913a90cc74-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b" returned: 0 in 0.287s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b2eb2a-8717-4c9d-995d-45fd2a22eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fb820b6-3963-43cd-9009-0a1aa881712b', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85815a50-1663-4c59-8097-fbac2b9aea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Lock "cinder-947ca13e-79db-4d7e-a8ad-4a913a90cc74-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:24 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Volume volume-3fb820b6-3963-43cd-9009-0a1aa881712b (3fb820b6-3963-43cd-9009-0a1aa881712b): created successfully Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85815a50-1663-4c59-8097-fbac2b9aea36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (d790d257-3403-42aa-aa57-9dc16266cad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:24 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-bd88af56-eac9-4530-acc3-34edfb7ffbd1 tempest-ProjectReaderTests-618562035 None] Created volume successfully. Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Acquiring lock "cinder-quobyte-947ca13e-79db-4d7e-a8ad-4a913a90cc74" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-8507640d-aae8-40b6-96c1-4bc6ba2ea9e0-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Lock "cinder-quobyte-947ca13e-79db-4d7e-a8ad-4a913a90cc74" acquired by "delete_volume" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Lock "cinder-8507640d-aae8-40b6-96c1-4bc6ba2ea9e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-dd8368b1-6690-4967-b227-4ec6eea855ca" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[11496ac9-ec14-4657-a477-4f7b85adfc3f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-dd8368b1-6690-4967-b227-4ec6eea855ca" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-8507640d-aae8-40b6-96c1-4bc6ba2ea9e0" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-8507640d-aae8-40b6-96c1-4bc6ba2ea9e0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Deleting offline snapshot 8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 of volume dd8368b1-6690-4967-b227-4ec6eea855ca {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] snapshot_file for this snap is: volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c033d49a-0f6a-49c7-9f62-ee297ceaf4b6]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:24 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 Sep 23 00:39:24 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:24 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 Sep 23 00:39:24 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Creating offline snapshot 74d1a682-f373-4d89-992b-9054dafdd3a9 of volume 3fb820b6-3963-43cd-9009-0a1aa881712b {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[61439c3a-fc41-4e1c-92b4-b9dcc48efd8d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:24 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74" returned: 0 in 0.497s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:24 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:24 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74 Sep 23 00:39:24 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:24 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b Sep 23 00:39:24 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:25 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0" returned: 0 in 0.564s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd8368b1-6690-4967-b227-4ec6eea855ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b313dea-b651-45f5-aa26-f3fff7b4cfe6]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:25 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-947ca13e-79db-4d7e-a8ad-4a913a90cc74" returned: 0 in 0.331s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:25 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca Sep 23 00:39:25 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Lock "cinder-quobyte-947ca13e-79db-4d7e-a8ad-4a913a90cc74" released by "delete_volume" :: held 0.929s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Created reservations ['b2473684-d6e6-4bb7-a42a-8fd32981ed18', '27574b5b-522e-45e2-b936-2c5e49b3b7d7', 'eec0c32b-f294-455e-963c-086c0258ef88', 'bde4a370-33d8-4012-b147-764d04519465', '5704a1bf-60d0-400a-9e81-69e684d1eaa8'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:25 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b" returned: 0 in 0.620s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:25 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 1G Sep 23 00:39:25 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:25 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:25 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:25 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca" returned: 0 in 0.567s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:25 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 Sep 23 00:39:25 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:25 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.346s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:25 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Deleted volume successfully. Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2817f7e4-a496-4522-a2d4-8745db02831e tempest-CinderUnicodeTest-605661430 None] Lock "cinder-947ca13e-79db-4d7e-a8ad-4a913a90cc74-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:25 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 1G" returned: 0 in 0.553s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:25 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb820b6-3963-43cd-9009-0a1aa881712b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:25 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb820b6-3963-43cd-9009-0a1aa881712b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 Sep 23 00:39:25 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:26 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0" returned: 0 in 0.407s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:26 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0 Sep 23 00:39:26 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:26 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fb820b6-3963-43cd-9009-0a1aa881712b -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9" returned: 0 in 0.363s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:26 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 is being set with open permissions: ugo+rw Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:26 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca.8507640d-aae8-40b6-96c1-4bc6ba2ea9e0" returned: 0 in 0.284s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:26 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 Sep 23 00:39:26 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-8507640d-aae8-40b6-96c1-4bc6ba2ea9e0" released by "_delete_snapshot" :: held 1.977s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-dd8368b1-6690-4967-b227-4ec6eea855ca" released by "delete_snapshot" :: held 2.019s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Created reservations ['0de6d880-9ab1-434e-8a4b-29201293eb7c', '5b538192-4955-4161-bc50-445ec05f0910', '539ebe1a-7275-46f6-881c-adddec6f3e60', '13f37313-c00d-456d-8b38-7e8306a9c874', '47e4e20a-a3ee-4a27-ac8a-343719b8f74f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Acquiring lock "cinder-4631c27f-81e0-4ea3-8c38-ff60a8d133df-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Lock "cinder-4631c27f-81e0-4ea3-8c38-ff60a8d133df-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:26 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Delete snapshot completed successfully. Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6f2c10a4-8383-4dec-9914-584a73596387 tempest-ProjectMemberTests-665542472 None] Lock "cinder-8507640d-aae8-40b6-96c1-4bc6ba2ea9e0-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Acquiring lock "cinder-quobyte-4631c27f-81e0-4ea3-8c38-ff60a8d133df" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:26 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9" returned: 0 in 0.350s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Lock "cinder-quobyte-4631c27f-81e0-4ea3-8c38-ff60a8d133df" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ecd7bd-68cb-4bcc-81d5-064b9470207b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:26 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.info Sep 23 00:39:26 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:26 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df Sep 23 00:39:26 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:26 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:26 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.info" returned: 0 in 0.318s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:26 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.info is being set with open permissions: ugo+rw Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:27 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.info Sep 23 00:39:27 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:27 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df" returned: 0 in 0.453s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:27 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df Sep 23 00:39:27 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:27 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.info" returned: 0 in 0.320s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:27 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-55c587a4-0f3c-4bc3-9f8e-29ec103b9a2a tempest-ProjectReaderTests-618562035 None] Create snapshot completed successfully Sep 23 00:39:27 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4631c27f-81e0-4ea3-8c38-ff60a8d133df" returned: 0 in 0.291s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Lock "cinder-quobyte-4631c27f-81e0-4ea3-8c38-ff60a8d133df" released by "delete_volume" :: held 0.805s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-dd8368b1-6690-4967-b227-4ec6eea855ca-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Lock "cinder-dd8368b1-6690-4967-b227-4ec6eea855ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Created reservations ['deb8a81b-fb0d-41ec-8e28-3b3d5e819f83', 'ae983acc-280a-42c7-ac54-17b094f17a22', '0d98492b-69f2-483a-9d66-5498349c6815', '3033e917-e56c-4044-befb-6cd380ad8d9d', '607a8d4c-5885-44ad-8fc3-d8b798e93cb9'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-dd8368b1-6690-4967-b227-4ec6eea855ca" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-dd8368b1-6690-4967-b227-4ec6eea855ca" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89d33ab-551d-4769-93bf-46947ab10e92]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:27 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:27 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:27 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca Sep 23 00:39:27 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-74d1a682-f373-4d89-992b-9054dafdd3a9-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Lock "cinder-74d1a682-f373-4d89-992b-9054dafdd3a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:27 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-3fb820b6-3963-43cd-9009-0a1aa881712b" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-3fb820b6-3963-43cd-9009-0a1aa881712b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-74d1a682-f373-4d89-992b-9054dafdd3a9" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-74d1a682-f373-4d89-992b-9054dafdd3a9" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Deleting offline snapshot 74d1a682-f373-4d89-992b-9054dafdd3a9 of volume 3fb820b6-3963-43cd-9009-0a1aa881712b {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] snapshot_file for this snap is: volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:28 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[324cd0c2-8186-418f-98e8-91a65c2763a0]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.428s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:28 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Deleted volume successfully. Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-b71ee699-d358-417c-81a5-b454df0a6778 tempest-CinderUnicodeTest-605661430 None] Lock "cinder-4631c27f-81e0-4ea3-8c38-ff60a8d133df-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:28 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca" returned: 0 in 0.599s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:28 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca Sep 23 00:39:28 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:28 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 Sep 23 00:39:28 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:28 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-dd8368b1-6690-4967-b227-4ec6eea855ca" returned: 0 in 0.325s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-dd8368b1-6690-4967-b227-4ec6eea855ca" released by "delete_volume" :: held 1.011s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Created reservations ['62ff3139-78fb-4393-88d9-095809256254', '9229fb1a-bb31-4888-b539-0bc3fd01dcd4', '09634288-93e1-4575-8d1e-7d0442329488', 'ab648573-435b-43b8-883a-4d83e1f2d55b', '643ba25e-aa92-4ae5-a2f0-527d1251c66c'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:28 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9" returned: 0 in 0.608s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fb820b6-3963-43cd-9009-0a1aa881712b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2413e8-4678-47fa-a7ce-3be06b94a18c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:28 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:28 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b Sep 23 00:39:28 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:28 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:28 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:29 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.388s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:29 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:29 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Deleted volume successfully. Sep 23 00:39:29 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b" returned: 0 in 0.506s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:29 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-0861de9b-8368-4ac7-8eb4-97111dae5519 tempest-ProjectMemberTests-665542472 None] Lock "cinder-dd8368b1-6690-4967-b227-4ec6eea855ca-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:29 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 Sep 23 00:39:29 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:29 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9" returned: 0 in 0.486s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:29 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:29 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9 Sep 23 00:39:29 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:30 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b.74d1a682-f373-4d89-992b-9054dafdd3a9" returned: 0 in 0.346s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-74d1a682-f373-4d89-992b-9054dafdd3a9" released by "_delete_snapshot" :: held 2.162s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-3fb820b6-3963-43cd-9009-0a1aa881712b" released by "delete_snapshot" :: held 2.202s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Created reservations ['29d4a69f-add1-4af8-816b-4b743b583819', '4dd5c276-52cc-4d82-94e2-b9f3fb20ea98', '341fd569-9677-498f-89e7-fb646d71b945', 'd3b30566-a0c0-4eaf-92cc-e7b1d6f78deb', 'e127c85f-7c79-4575-8286-99668e7ddd69'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:30 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Delete snapshot completed successfully. Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f40423d8-9252-4462-88b0-b147e9f63b33 tempest-ProjectReaderTests-618562035 None] Lock "cinder-74d1a682-f373-4d89-992b-9054dafdd3a9-delete_snapshot" released by "delete_snapshot" :: held 2.498s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (4e1bc7ed-2d24-46f0-b878-04edea7a8600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd036030-984b-497c-8c64-4e180cd07ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd036030-984b-497c-8c64-4e180cd07ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1017784384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ee4b0a-c787-4cec-b30e-5065d14b7047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:31Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2a6e6c-eede-4a1a-876e-034c60f2b35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f2a6e6c-eede-4a1a-876e-034c60f2b35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ed3b44-2ebd-4313-a791-da0717c73343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ed3b44-2ebd-4313-a791-da0717c73343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ee4b0a-c787-4cec-b30e-5065d14b7047', 'volume_name': 'volume-03ee4b0a-c787-4cec-b30e-5065d14b7047', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176b2c38-9986-4f21-9e08-31d9fde61cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176b2c38-9986-4f21-9e08-31d9fde61cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d00521-3e60-47b0-a5d3-b65c9506b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:30 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Volume 03ee4b0a-c787-4cec-b30e-5065d14b7047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ee4b0a-c787-4cec-b30e-5065d14b7047', 'volume_size': 1} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1017784384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ee4b0a-c787-4cec-b30e-5065d14b7047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:31Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Creating volume 03ee4b0a-c787-4cec-b30e-5065d14b7047 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:30 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:30 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:30 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 1073741824 Sep 23 00:39:30 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-3fb820b6-3963-43cd-9009-0a1aa881712b-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:31 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 1073741824" returned: 0 in 0.615s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Lock "cinder-3fb820b6-3963-43cd-9009-0a1aa881712b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-3fb820b6-3963-43cd-9009-0a1aa881712b" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-3fb820b6-3963-43cd-9009-0a1aa881712b" acquired by "delete_volume" :: waited 0.030s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:31 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 Sep 23 00:39:31 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda62f6f-ef3d-4d64-a716-b8eaa2df23e3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:31 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b Sep 23 00:39:31 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:31 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047" returned: 0 in 0.329s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d00521-3e60-47b0-a5d3-b65c9506b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ee4b0a-c787-4cec-b30e-5065d14b7047', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bfcbbd-7abe-4d4b-9e73-c9a1d6f364f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:31 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Volume volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 (03ee4b0a-c787-4cec-b30e-5065d14b7047): created successfully Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8bfcbbd-7abe-4d4b-9e73-c9a1d6f364f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:31 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (4e1bc7ed-2d24-46f0-b878-04edea7a8600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:31 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a29536ec-ce79-491e-95b6-2b7ff7851ab9 tempest-ProjectMemberTests-665542472 None] Created volume successfully. Sep 23 00:39:32 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b" returned: 0 in 0.437s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:32 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b Sep 23 00:39:32 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:32 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-3fb820b6-3963-43cd-9009-0a1aa881712b" returned: 0 in 0.299s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-3fb820b6-3963-43cd-9009-0a1aa881712b" released by "delete_volume" :: held 0.838s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Created reservations ['ed851ba8-1fa3-42b6-aef3-15f4f2aa6e6a', 'a5f6453e-cf78-4090-bb98-bd770d82e713', 'a26bf7e1-3905-4f8b-9a79-5cc5dac6d7d4', '89d7dcb4-e0d0-46d3-84e5-8b080eb47991', 'ea1c13b4-5994-4cfe-bc62-63a064c6ce61'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:32 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:32 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:32 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.368s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:32 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Deleted volume successfully. Sep 23 00:39:32 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d724bca6-23e0-4b5e-8d30-c927dfef93ec tempest-ProjectReaderTests-618562035 None] Lock "cinder-3fb820b6-3963-43cd-9009-0a1aa881712b-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Creating offline snapshot 5aa25bce-0f52-443d-8eee-00ab4f2d3e17 of volume 03ee4b0a-c787-4cec-b30e-5065d14b7047 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1ce11f-5266-4010-a878-fc12dccf47d4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:33 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 Sep 23 00:39:33 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (14b9913c-c120-447d-b935-8a0058e51b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95552354-a6d4-4b2a-9822-c68345542f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95552354-a6d4-4b2a-9822-c68345542f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510834093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd3a803-1fa9-48ff-b1a4-2e92184bacbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:33Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f47481-f58e-4929-bb43-ef035fd703bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21f47481-f58e-4929-bb43-ef035fd703bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a3e6d6-c82f-4adc-819b-48d1c1aa99ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a3e6d6-c82f-4adc-819b-48d1c1aa99ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fd3a803-1fa9-48ff-b1a4-2e92184bacbd', 'volume_name': 'volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412c32a4-5e36-4f6b-8d23-73d27e327607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412c32a4-5e36-4f6b-8d23-73d27e327607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9658b7-b81e-4c8c-aa75-07943b6145c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:33 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Volume 7fd3a803-1fa9-48ff-b1a4-2e92184bacbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd', 'volume_size': 1} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:33 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047" returned: 0 in 0.485s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:33 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:33 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 1G Sep 23 00:39:33 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:34 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 1G" returned: 0 in 0.545s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:34 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 Sep 23 00:39:34 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:34 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17" returned: 0 in 0.379s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:34 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 is being set with open permissions: ugo+rw Sep 23 00:39:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:34 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 Sep 23 00:39:34 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:34 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17" returned: 0 in 0.284s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:34 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.info Sep 23 00:39:34 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:35 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.info" returned: 0 in 0.291s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:35 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.info is being set with open permissions: ugo+rw Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:35 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.info Sep 23 00:39:35 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:35 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.info" returned: 0 in 0.303s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.984s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-510834093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fd3a803-1fa9-48ff-b1a4-2e92184bacbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:33Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Creating volume 7fd3a803-1fa9-48ff-b1a4-2e92184bacbd {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:35 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:35 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd 1073741824 Sep 23 00:39:35 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-042e4e1b-33f2-4dfa-8e1b-fcdb349ca0db tempest-ProjectMemberTests-665542472 None] Create snapshot completed successfully Sep 23 00:39:35 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd 1073741824" returned: 0 in 0.536s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:36 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd Sep 23 00:39:36 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-5aa25bce-0f52-443d-8eee-00ab4f2d3e17-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:36 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" returned: 0 in 0.330s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Lock "cinder-5aa25bce-0f52-443d-8eee-00ab4f2d3e17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-03ee4b0a-c787-4cec-b30e-5065d14b7047" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9658b7-b81e-4c8c-aa75-07943b6145c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130208ac-01ae-4745-88b5-1e753bfdec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-03ee4b0a-c787-4cec-b30e-5065d14b7047" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-5aa25bce-0f52-443d-8eee-00ab4f2d3e17" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:36 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Volume volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd (7fd3a803-1fa9-48ff-b1a4-2e92184bacbd): created successfully Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130208ac-01ae-4745-88b5-1e753bfdec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (14b9913c-c120-447d-b935-8a0058e51b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-5aa25bce-0f52-443d-8eee-00ab4f2d3e17" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Deleting offline snapshot 5aa25bce-0f52-443d-8eee-00ab4f2d3e17 of volume 03ee4b0a-c787-4cec-b30e-5065d14b7047 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] snapshot_file for this snap is: volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:36 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4e2ffe52-29d4-49bb-ac37-76e8691c0959 tempest-ProjectReaderTests-618562035 None] Created volume successfully. Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31c5006-3dbf-4410-903e-00e12af5de02]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:36 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 Sep 23 00:39:36 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:36 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17" returned: 0 in 0.452s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:36 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03ee4b0a-c787-4cec-b30e-5065d14b7047(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1c9b6a-79fa-4f8d-a1d2-bc553acad216]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:37 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 Sep 23 00:39:37 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:37 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047" returned: 0 in 0.410s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:37 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 Sep 23 00:39:37 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Creating offline snapshot 2cda9f97-2947-40c4-934b-1843468f1280 of volume 7fd3a803-1fa9-48ff-b1a4-2e92184bacbd {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef9194b-eece-4ada-8d35-979529c2caf1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:37 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17" returned: 0 in 0.390s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:37 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17 Sep 23 00:39:37 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:37 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd Sep 23 00:39:37 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:38 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047.5aa25bce-0f52-443d-8eee-00ab4f2d3e17" returned: 0 in 0.261s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-5aa25bce-0f52-443d-8eee-00ab4f2d3e17" released by "_delete_snapshot" :: held 1.649s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-03ee4b0a-c787-4cec-b30e-5065d14b7047" released by "delete_snapshot" :: held 1.691s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Created reservations ['6fe2fe19-d207-4839-9af7-a3414067c9e4', '504ba8e6-4194-4a8c-b95b-33b23edcf146', 'bd79cbea-5960-487b-a1b0-4177517d3405', 'dd0a69bf-86de-4627-afa0-aa74d42f6ed4', 'fa787aa4-82f0-4094-8377-651e2b2205b9'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:38 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" returned: 0 in 0.465s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:38 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 1G Sep 23 00:39:38 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:38 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Delete snapshot completed successfully. Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e0425cd3-b5ce-4ac4-9d3a-23089e00411e tempest-ProjectMemberTests-665542472 None] Lock "cinder-5aa25bce-0f52-443d-8eee-00ab4f2d3e17-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-03ee4b0a-c787-4cec-b30e-5065d14b7047-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Lock "cinder-03ee4b0a-c787-4cec-b30e-5065d14b7047-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-03ee4b0a-c787-4cec-b30e-5065d14b7047" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-03ee4b0a-c787-4cec-b30e-5065d14b7047" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[789cb603-7383-4cc3-9192-e7282994c41e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:38 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 1G" returned: 0 in 0.517s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:38 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 Sep 23 00:39:38 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:38 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 Sep 23 00:39:38 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:39 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280" returned: 0 in 0.322s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:39 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 is being set with open permissions: ugo+rw Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:39 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047" returned: 0 in 0.413s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:39 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 Sep 23 00:39:39 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:39 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047 Sep 23 00:39:39 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:39 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280" returned: 0 in 0.307s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:39 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-03ee4b0a-c787-4cec-b30e-5065d14b7047" returned: 0 in 0.304s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-03ee4b0a-c787-4cec-b30e-5065d14b7047" released by "delete_volume" :: held 0.797s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:39 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.info Sep 23 00:39:39 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Created reservations ['2c0025fa-2705-42ff-b149-9042322cb43f', 'cc66f23e-4425-4a77-8856-1046a0ea5a16', 'b9aa4ab1-0738-4b69-8a5d-56b0237950a6', '3dffaf7a-b725-40e6-8613-db723719b2c9', '32481be8-744e-4b63-95c2-5febea7a6188'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:39 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:39 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:39 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.info" returned: 0 in 0.315s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:39 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.info is being set with open permissions: ugo+rw Sep 23 00:39:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:39 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.info Sep 23 00:39:39 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:40 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.378s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Deleted volume successfully. Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d7a05607-99f9-441c-bcbb-0addd57df780 tempest-ProjectMemberTests-665542472 None] Lock "cinder-03ee4b0a-c787-4cec-b30e-5065d14b7047-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:40 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.info" returned: 0 in 0.377s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:40 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e584101d-32fd-4039-9ec2-45451a961272 tempest-ProjectReaderTests-618562035 None] Create snapshot completed successfully Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (39550d71-0af9-45dc-a2c1-7e5dae44209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f62283-0e7e-435b-adfe-040f0ed5b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f62283-0e7e-435b-adfe-040f0ed5b177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560128229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee050c53-51b4-4c09-9044-0c1e67968036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:40Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5d4059-d1a5-404f-bd13-4fab076baf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5d4059-d1a5-404f-bd13-4fab076baf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7271ed79-0803-4f4c-a7f8-de953c920221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7271ed79-0803-4f4c-a7f8-de953c920221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee050c53-51b4-4c09-9044-0c1e67968036', 'volume_name': 'volume-ee050c53-51b4-4c09-9044-0c1e67968036', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e4b330-0844-4a42-aa33-447f61b1ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e4b330-0844-4a42-aa33-447f61b1ae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4175819-5652-483a-be9c-49a47b0fa4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:40 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Volume ee050c53-51b4-4c09-9044-0c1e67968036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee050c53-51b4-4c09-9044-0c1e67968036', 'volume_size': 1} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1560128229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee050c53-51b4-4c09-9044-0c1e67968036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:40Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Creating volume ee050c53-51b4-4c09-9044-0c1e67968036 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:40 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:40 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 1073741824 Sep 23 00:39:40 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:40 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 1073741824" returned: 0 in 0.462s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-2cda9f97-2947-40c4-934b-1843468f1280-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Lock "cinder-2cda9f97-2947-40c4-934b-1843468f1280-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:41 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 Sep 23 00:39:41 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-2cda9f97-2947-40c4-934b-1843468f1280" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2cda9f97-2947-40c4-934b-1843468f1280" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Deleting offline snapshot 2cda9f97-2947-40c4-934b-1843468f1280 of volume 7fd3a803-1fa9-48ff-b1a4-2e92184bacbd {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] snapshot_file for this snap is: volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c8fa3a-8fd5-44c2-8032-17f12a75858c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:41 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 Sep 23 00:39:41 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:41 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036" returned: 0 in 0.295s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4175819-5652-483a-be9c-49a47b0fa4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee050c53-51b4-4c09-9044-0c1e67968036', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19f3915-5586-4c4e-a394-85fc809c7652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:41 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Volume volume-ee050c53-51b4-4c09-9044-0c1e67968036 (ee050c53-51b4-4c09-9044-0c1e67968036): created successfully Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19f3915-5586-4c4e-a394-85fc809c7652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (39550d71-0af9-45dc-a2c1-7e5dae44209f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:41 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-146db574-4711-4bd7-8b6d-1c944fe7d67b tempest-ProjectMemberTests-665542472 None] Created volume successfully. Sep 23 00:39:41 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280" returned: 0 in 0.378s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e16e495-f5ce-421d-a639-42300001cbca]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:41 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd Sep 23 00:39:41 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:41 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" returned: 0 in 0.354s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:41 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 Sep 23 00:39:41 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:42 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280" returned: 0 in 0.336s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:42 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280 Sep 23 00:39:42 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:42 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:42 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd.2cda9f97-2947-40c4-934b-1843468f1280" returned: 0 in 0.255s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2cda9f97-2947-40c4-934b-1843468f1280" released by "_delete_snapshot" :: held 1.444s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" released by "delete_snapshot" :: held 1.467s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:42 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Created reservations ['17ee6cfc-fab7-4c3c-8c7e-d50b333737ef', '127e239a-945e-408e-9037-32300749e5a5', '329ffd0f-0cf8-4763-a8b2-56dd0241426d', 'd2dc8b17-022e-4b39-bd1a-9b51520f8f77', '1c916b01-8001-4813-9b79-1d0d5d02775b'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:42 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Delete snapshot completed successfully. Sep 23 00:39:42 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-59b1410c-7326-415c-8fdc-d46356d470f0 tempest-ProjectReaderTests-618562035 None] Lock "cinder-2cda9f97-2947-40c4-934b-1843468f1280-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Lock "cinder-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" acquired by "delete_volume" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3d1ef4-17c8-4e0b-bd71-630d141a6075]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:43 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd Sep 23 00:39:43 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:43 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" returned: 0 in 0.407s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:43 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd Sep 23 00:39:43 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Creating offline snapshot 01eb2995-71b7-4ca6-bc57-54199440fc08 of volume ee050c53-51b4-4c09-9044-0c1e67968036 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[77acd543-a560-4ba4-910d-9df24c106c98]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:43 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 Sep 23 00:39:43 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:43 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" returned: 0 in 0.271s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:43 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd" released by "delete_volume" :: held 0.742s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Created reservations ['ee448d99-3d50-4a5c-a6b8-2167da9de96c', '99d0de1c-1a2d-4da0-b322-8f35a6204146', 'b1fb2a09-3769-4205-8ce5-5b95bb2bffcf', '7c49aa6d-b696-46c0-bd27-bb7d5627ef5a', '2d05cc3b-9793-4c8e-a44b-a9c3f1ee3574'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:44 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:44 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:44 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036" returned: 0 in 0.399s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:44 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 1G Sep 23 00:39:44 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:44 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.270s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:44 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Deleted volume successfully. Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-2d3d3292-dc6a-40a8-b16f-14eaf60ee469 tempest-ProjectReaderTests-618562035 None] Lock "cinder-7fd3a803-1fa9-48ff-b1a4-2e92184bacbd-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:44 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 1G" returned: 0 in 0.493s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee050c53-51b4-4c09-9044-0c1e67968036 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:44 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee050c53-51b4-4c09-9044-0c1e67968036 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 Sep 23 00:39:44 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (f065874c-2b83-4f37-95f6-a6cba62cfae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f367c7-2378-49b6-9f70-55a5b514f8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f367c7-2378-49b6-9f70-55a5b514f8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145505802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1ba3e4-ab31-46ff-962d-43425803764e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:45Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002ab50d-3d63-4759-bbf2-fe56854a63f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002ab50d-3d63-4759-bbf2-fe56854a63f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f342e5b-12b1-42b3-82b4-292afcd41952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f342e5b-12b1-42b3-82b4-292afcd41952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1ba3e4-ab31-46ff-962d-43425803764e', 'volume_name': 'volume-2e1ba3e4-ab31-46ff-962d-43425803764e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3477421-2efb-4e62-97ba-4782708ee5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3477421-2efb-4e62-97ba-4782708ee5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f52e34-e0cd-4c0d-8be7-1f481d505fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:44 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Volume 2e1ba3e4-ab31-46ff-962d-43425803764e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1ba3e4-ab31-46ff-962d-43425803764e', 'volume_size': 1} Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:44 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee050c53-51b4-4c09-9044-0c1e67968036 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08" returned: 0 in 0.325s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:44 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 is being set with open permissions: ugo+rw Sep 23 00:39:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:44 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 Sep 23 00:39:44 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:45 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08" returned: 0 in 0.253s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:45 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.info Sep 23 00:39:45 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:45 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.info" returned: 0 in 0.261s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:45 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.info is being set with open permissions: ugo+rw Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:45 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.info Sep 23 00:39:45 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:45 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.info" returned: 0 in 0.246s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145505802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1ba3e4-ab31-46ff-962d-43425803764e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:45Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Creating volume 2e1ba3e4-ab31-46ff-962d-43425803764e {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:45 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:45 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e 1073741824 Sep 23 00:39:45 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:45 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f3e80cf4-a25e-42f9-a8ec-7b8015095cf8 tempest-ProjectMemberTests-665542472 None] Create snapshot completed successfully Sep 23 00:39:46 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e 1073741824" returned: 0 in 0.422s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:46 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e Sep 23 00:39:46 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:46 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e" returned: 0 in 0.245s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f52e34-e0cd-4c0d-8be7-1f481d505fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1ba3e4-ab31-46ff-962d-43425803764e', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17db629e-d5b2-42db-b4f4-b75e48b3957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:46 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Volume volume-2e1ba3e4-ab31-46ff-962d-43425803764e (2e1ba3e4-ab31-46ff-962d-43425803764e): created successfully Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17db629e-d5b2-42db-b4f4-b75e48b3957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (f065874c-2b83-4f37-95f6-a6cba62cfae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a90d5da5-971b-4a08-9adf-e2c5c4e101f8 tempest-ProjectReaderTests-618562035 None] Created volume successfully. Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-01eb2995-71b7-4ca6-bc57-54199440fc08-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Lock "cinder-01eb2995-71b7-4ca6-bc57-54199440fc08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-ee050c53-51b4-4c09-9044-0c1e67968036" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-ee050c53-51b4-4c09-9044-0c1e67968036" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-01eb2995-71b7-4ca6-bc57-54199440fc08" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-01eb2995-71b7-4ca6-bc57-54199440fc08" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Deleting offline snapshot 01eb2995-71b7-4ca6-bc57-54199440fc08 of volume ee050c53-51b4-4c09-9044-0c1e67968036 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] snapshot_file for this snap is: volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb554e5-67f4-4354-9750-457d62a35ad1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:47 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 Sep 23 00:39:47 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Creating offline snapshot a89ef30c-6e66-4fc6-8017-ceaa71a5f91f of volume 2e1ba3e4-ab31-46ff-962d-43425803764e {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e879362-db13-4534-a76a-fda5cb9efabc]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:47 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e Sep 23 00:39:47 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:47 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08" returned: 0 in 0.382s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee050c53-51b4-4c09-9044-0c1e67968036(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[74914c72-3077-4b0b-8b29-5f7eff82eca4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:47 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 Sep 23 00:39:47 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:47 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e" returned: 0 in 0.385s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:47 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f 1G Sep 23 00:39:47 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:47 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036" returned: 0 in 0.378s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:47 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 Sep 23 00:39:47 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:47 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f 1G" returned: 0 in 0.435s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e1ba3e4-ab31-46ff-962d-43425803764e -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:48 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e1ba3e4-ab31-46ff-962d-43425803764e -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f Sep 23 00:39:48 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:48 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08" returned: 0 in 0.359s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:48 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08 Sep 23 00:39:48 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:48 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e1ba3e4-ab31-46ff-962d-43425803764e -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f" returned: 0 in 0.321s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:48 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f is being set with open permissions: ugo+rw Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:48 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f Sep 23 00:39:48 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:48 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036.01eb2995-71b7-4ca6-bc57-54199440fc08" returned: 0 in 0.287s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-01eb2995-71b7-4ca6-bc57-54199440fc08" released by "_delete_snapshot" :: held 1.515s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-ee050c53-51b4-4c09-9044-0c1e67968036" released by "delete_snapshot" :: held 1.543s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Created reservations ['4ca91bfa-efd1-4e9f-b9e3-7e3efe927a02', '6c8193cb-4cb9-4f6d-abbc-6c6b6624513c', 'da068e74-7864-4171-83b6-5e63ce6dd5ce', 'c39486ee-129e-4b42-8640-67fffd353a31', 'e05e2b22-e554-4a8e-b7dc-5a2882d19478'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:48 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:48 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Delete snapshot completed successfully. Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f" returned: 0 in 0.265s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-54bbd3fa-0dbd-4148-8192-205d3cf5818d tempest-ProjectMemberTests-665542472 None] Lock "cinder-01eb2995-71b7-4ca6-bc57-54199440fc08-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:48 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.info Sep 23 00:39:48 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:48 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.info" returned: 0 in 0.257s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:48 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.info is being set with open permissions: ugo+rw Sep 23 00:39:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:48 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.info Sep 23 00:39:48 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-ee050c53-51b4-4c09-9044-0c1e67968036-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Lock "cinder-ee050c53-51b4-4c09-9044-0c1e67968036-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-ee050c53-51b4-4c09-9044-0c1e67968036" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-ee050c53-51b4-4c09-9044-0c1e67968036" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:49 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.info" returned: 0 in 0.278s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef824056-03d1-443a-81a8-ba9254526827]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a646a769-be37-468c-a7ed-27ed1c60daf3 tempest-ProjectReaderTests-618562035 None] Create snapshot completed successfully Sep 23 00:39:49 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 Sep 23 00:39:49 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:49 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036" returned: 0 in 0.376s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:49 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036 Sep 23 00:39:49 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:49 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-ee050c53-51b4-4c09-9044-0c1e67968036" returned: 0 in 0.255s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-ee050c53-51b4-4c09-9044-0c1e67968036" released by "delete_volume" :: held 0.720s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Created reservations ['1664041c-fe4a-4f50-b0fc-4da30a72d8e7', 'fd9a0a1e-14ae-47d7-937d-c1170517fbe6', 'd5798892-0204-44c6-94aa-8d29aa39b2d6', 'b1f6b9cb-d18e-4057-969a-859ea6777fef', '416adbde-f25f-4a86-8ef8-23d4aa549820'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:49 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:49 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:50 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.268s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:50 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Deleted volume successfully. Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-a247c276-4685-4f07-ab01-e4334078a2e7 tempest-ProjectMemberTests-665542472 None] Lock "cinder-ee050c53-51b4-4c09-9044-0c1e67968036-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-a89ef30c-6e66-4fc6-8017-ceaa71a5f91f-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Lock "cinder-a89ef30c-6e66-4fc6-8017-ceaa71a5f91f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-2e1ba3e4-ab31-46ff-962d-43425803764e" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2e1ba3e4-ab31-46ff-962d-43425803764e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-a89ef30c-6e66-4fc6-8017-ceaa71a5f91f" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-a89ef30c-6e66-4fc6-8017-ceaa71a5f91f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Deleting offline snapshot a89ef30c-6e66-4fc6-8017-ceaa71a5f91f of volume 2e1ba3e4-ab31-46ff-962d-43425803764e {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] snapshot_file for this snap is: volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[381b3e1b-e9db-4213-93d0-c7bb1da3f50d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:50 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f Sep 23 00:39:50 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (0671f6d3-36a0-476f-8c02-6102b6e64631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2bf529-35b2-4357-84ca-b001d6e04064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2bf529-35b2-4357-84ca-b001d6e04064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1042182289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f45ef66-07a1-47f7-9f15-e024eae5cb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:51Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2320ca5f-601f-4a1f-94e5-3dd38cf78d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2320ca5f-601f-4a1f-94e5-3dd38cf78d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:50 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7a611b-3cf6-40c4-a36a-32062866c426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7a611b-3cf6-40c4-a36a-32062866c426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f45ef66-07a1-47f7-9f15-e024eae5cb16', 'volume_name': 'volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01b68bd-35bb-4350-9ce3-6f7546b312f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c01b68bd-35bb-4350-9ce3-6f7546b312f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cba0a6-f8b7-47dd-878b-2ecfaa197758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:50 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Volume 1f45ef66-07a1-47f7-9f15-e024eae5cb16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16', 'volume_size': 1} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1042182289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f45ef66-07a1-47f7-9f15-e024eae5cb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:51Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Creating volume 1f45ef66-07a1-47f7-9f15-e024eae5cb16 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:50 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f" returned: 0 in 0.432s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e1ba3e4-ab31-46ff-962d-43425803764e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:50 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 1073741824 Sep 23 00:39:50 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2897e00-efee-430a-a2cf-165ab88f9638]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:50 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e Sep 23 00:39:50 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:51 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:51 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e" returned: 0 in 0.382s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 1073741824" returned: 0 in 0.439s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:51 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f Sep 23 00:39:51 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:51 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 Sep 23 00:39:51 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:51 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16" returned: 0 in 0.255s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cba0a6-f8b7-47dd-878b-2ecfaa197758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485a10fe-4290-4213-b960-23627f917b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:51 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Volume volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 (1f45ef66-07a1-47f7-9f15-e024eae5cb16): created successfully Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485a10fe-4290-4213-b960-23627f917b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:51 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (0671f6d3-36a0-476f-8c02-6102b6e64631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f" returned: 0 in 0.357s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5ee71c81-030a-4ad5-bf84-9bf9956d44ff tempest-ProjectMemberTests-665542472 None] Created volume successfully. Sep 23 00:39:51 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f Sep 23 00:39:51 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:51 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e.a89ef30c-6e66-4fc6-8017-ceaa71a5f91f" returned: 0 in 0.271s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-a89ef30c-6e66-4fc6-8017-ceaa71a5f91f" released by "_delete_snapshot" :: held 1.558s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2e1ba3e4-ab31-46ff-962d-43425803764e" released by "delete_snapshot" :: held 1.583s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Creating offline snapshot ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc of volume 1f45ef66-07a1-47f7-9f15-e024eae5cb16 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[793c8657-b4d4-41c1-94f9-effea9343008]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Created reservations ['7cca0c78-9a48-4711-904f-4dd3cd77916c', 'd5a77b68-257e-4cbd-b852-0e5510f364cd', 'a72effc5-72f7-4de4-95ec-35e4a7400be1', 'f2dc007f-65fc-4acd-a7a4-3b97b707c1d1', '9c6f1d75-212f-4b73-b02f-05537983c9b7'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:52 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Delete snapshot completed successfully. Sep 23 00:39:52 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8eb5fc36-cce3-411a-a82b-675ac4c7b9c9 tempest-ProjectReaderTests-618562035 None] Lock "cinder-a89ef30c-6e66-4fc6-8017-ceaa71a5f91f-delete_snapshot" released by "delete_snapshot" :: held 1.765s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:52 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:52 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16" returned: 0 in 0.359s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:52 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc 1G Sep 23 00:39:52 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-2e1ba3e4-ab31-46ff-962d-43425803764e-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Lock "cinder-2e1ba3e4-ab31-46ff-962d-43425803764e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-2e1ba3e4-ab31-46ff-962d-43425803764e" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2e1ba3e4-ab31-46ff-962d-43425803764e" acquired by "delete_volume" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c61116-82c6-473b-bf44-8cc29d656ed8]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:52 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e Sep 23 00:39:52 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:52 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc 1G" returned: 0 in 0.437s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:52 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc Sep 23 00:39:52 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:52 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e" returned: 0 in 0.389s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:52 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e Sep 23 00:39:52 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:53 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc" returned: 0 in 0.323s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:53 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc is being set with open permissions: ugo+rw Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:53 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc Sep 23 00:39:53 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:53 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2e1ba3e4-ab31-46ff-962d-43425803764e" returned: 0 in 0.273s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2e1ba3e4-ab31-46ff-962d-43425803764e" released by "delete_volume" :: held 0.734s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Created reservations ['73c743af-ef11-4cb4-bb43-80e6c1a7ef24', 'ed07edbd-0b73-4727-be41-a3917035e8d6', '91fc03e5-c6b3-40f7-ae52-c2f09951589e', '53d94ce6-7b98-475f-b377-c5aebba9a8ff', '329a8883-12b4-4389-90cb-927d42f00340'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:53 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc" returned: 0 in 0.269s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:53 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.info Sep 23 00:39:53 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:53 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:53 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:53 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.info" returned: 0 in 0.277s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:53 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.info is being set with open permissions: ugo+rw Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:53 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:53 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.info Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.269s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:53 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:53 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Deleted volume successfully. Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-58eced8c-4884-4866-af6d-f039aec96302 tempest-ProjectReaderTests-618562035 None] Lock "cinder-2e1ba3e4-ab31-46ff-962d-43425803764e-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:53 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.info" returned: 0 in 0.272s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:53 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3b37a55f-4699-4e59-903f-4c7c102d836b tempest-ProjectMemberTests-665542472 None] Create snapshot completed successfully Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (e0a5e11c-cae7-43d3-9941-f13e66ead8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc5e16a-7c66-430e-8aa9-179a8dd9d7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc5e16a-7c66-430e-8aa9-179a8dd9d7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2002276251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2709d6-6710-48b0-9ba4-cc82a1646cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:54Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8868c85e-7a4c-432e-a6e5-a6486a2d8cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8868c85e-7a4c-432e-a6e5-a6486a2d8cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabd646a-7574-48ee-b84d-d88544e568ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabd646a-7574-48ee-b84d-d88544e568ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2709d6-6710-48b0-9ba4-cc82a1646cdf', 'volume_name': 'volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467da433-f98b-470d-913e-348df1b2aea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467da433-f98b-470d-913e-348df1b2aea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ec8c68-4c57-4af8-be8c-bcef1e514fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:54 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Volume 2f2709d6-6710-48b0-9ba4-cc82a1646cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf', 'volume_size': 1} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2002276251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2709d6-6710-48b0-9ba4-cc82a1646cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce734df07c3420b9c2915b78fcffeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:54Z,use_quota=True,user_id='b1f0cccc0aa5489da1e22ff71948897a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Creating volume 2f2709d6-6710-48b0-9ba4-cc82a1646cdf {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:54 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:54 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf 1073741824 Sep 23 00:39:54 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:54 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf 1073741824" returned: 0 in 0.411s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:54 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf Sep 23 00:39:54 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:54 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" returned: 0 in 0.246s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ec8c68-4c57-4af8-be8c-bcef1e514fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912e30bc-fccc-409d-b6ef-3655dcb4b998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:54 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Volume volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf (2f2709d6-6710-48b0-9ba4-cc82a1646cdf): created successfully Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (912e30bc-fccc-409d-b6ef-3655dcb4b998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:54 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Flow 'volume_create_manager' (e0a5e11c-cae7-43d3-9941-f13e66ead8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:54 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1e0bd5ac-cef9-48a5-91d1-3b76d41989e4 tempest-ProjectReaderTests-618562035 None] Created volume successfully. Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Lock "cinder-ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-1f45ef66-07a1-47f7-9f15-e024eae5cb16" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-1f45ef66-07a1-47f7-9f15-e024eae5cb16" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Deleting offline snapshot ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc of volume 1f45ef66-07a1-47f7-9f15-e024eae5cb16 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] snapshot_file for this snap is: volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a16579-aeac-4f55-8dfc-f726c6451e7d]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:55 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc Sep 23 00:39:55 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Creating offline snapshot b89c2a55-67fa-4601-b141-2ec22b80dc71 of volume 2f2709d6-6710-48b0-9ba4-cc82a1646cdf {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[52130ec9-bfec-4a37-ab78-94c4e90547c1]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:55 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf Sep 23 00:39:55 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:55 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc" returned: 0 in 0.425s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7a3658-4eb1-4d82-99a8-ec3592b884f4]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:55 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 Sep 23 00:39:55 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:55 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" returned: 0 in 0.389s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:55 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:55 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 1G Sep 23 00:39:55 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:56 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16" returned: 0 in 0.373s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:56 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc Sep 23 00:39:56 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:56 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 1G" returned: 0 in 0.403s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:56 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 Sep 23 00:39:56 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:56 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc" returned: 0 in 0.345s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:56 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc Sep 23 00:39:56 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:56 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71" returned: 0 in 0.301s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:56 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 is being set with open permissions: ugo+rw Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:56 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 Sep 23 00:39:56 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:56 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16.ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc" returned: 0 in 0.253s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc" released by "_delete_snapshot" :: held 1.527s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-1f45ef66-07a1-47f7-9f15-e024eae5cb16" released by "delete_snapshot" :: held 1.550s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Created reservations ['7018e4c7-33c0-4b85-a860-15df75395e07', '050f23ff-2720-40b4-8a7b-06856edb5812', '7577272d-a429-45c6-8647-cc8aaa18d52d', '256d6773-bad6-4a59-98de-80dfdac0b0d4', '5849fe39-e372-42bc-963e-033d83a99c5f'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:56 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71" returned: 0 in 0.245s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:56 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Delete snapshot completed successfully. Sep 23 00:39:56 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.info Sep 23 00:39:56 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:56 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3faa26ea-89ec-4cd6-83c5-c4a290f40e1d tempest-ProjectMemberTests-665542472 None] Lock "cinder-ef4fa1a0-4e4f-4474-84ff-5d16e8603cfc-delete_snapshot" released by "delete_snapshot" :: held 1.718s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:57 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.info" returned: 0 in 0.249s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:57 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.info is being set with open permissions: ugo+rw Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:57 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.info Sep 23 00:39:57 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-1f45ef66-07a1-47f7-9f15-e024eae5cb16-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Lock "cinder-1f45ef66-07a1-47f7-9f15-e024eae5cb16-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:57 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.info" returned: 0 in 0.270s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-1f45ef66-07a1-47f7-9f15-e024eae5cb16" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-1f45ef66-07a1-47f7-9f15-e024eae5cb16" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1c389e31-f8ed-471d-a586-f0c646262224 tempest-ProjectReaderTests-618562035 None] Create snapshot completed successfully Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21457ab-7b49-4097-8937-00ad719da87e]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:57 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 Sep 23 00:39:57 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:57 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16" returned: 0 in 0.353s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:57 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16 Sep 23 00:39:57 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:57 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1f45ef66-07a1-47f7-9f15-e024eae5cb16" returned: 0 in 0.242s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-1f45ef66-07a1-47f7-9f15-e024eae5cb16" released by "delete_volume" :: held 0.664s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Created reservations ['0608c68d-24a3-4010-8e8e-916e61df047b', 'dcdc535b-692a-44dd-b015-725108fe6661', '721d10cf-d93b-4fda-ab7b-622df7df64a8', '0c54c411-caed-4cd7-b67f-a0489437877f', 'f86235ad-4b42-47bf-a80c-4afffd4ccf5b'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:58 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:39:58 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:58 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.258s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:39:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Deleted volume successfully. Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3fa49f9c-a2f1-4778-b9d4-0d9378b252c5 tempest-ProjectMemberTests-665542472 None] Lock "cinder-1f45ef66-07a1-47f7-9f15-e024eae5cb16-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-b89c2a55-67fa-4601-b141-2ec22b80dc71-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Lock "cinder-b89c2a55-67fa-4601-b141-2ec22b80dc71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-b89c2a55-67fa-4601-b141-2ec22b80dc71" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-b89c2a55-67fa-4601-b141-2ec22b80dc71" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Deleting offline snapshot b89c2a55-67fa-4601-b141-2ec22b80dc71 of volume 2f2709d6-6710-48b0-9ba4-cc82a1646cdf {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] snapshot_file for this snap is: volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20d2114-0ae0-48e5-86ac-301e8d4a30e5]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:58 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 Sep 23 00:39:58 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (9f6783d3-e6b3-4260-ae0c-73fdcff0f92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575979a5-c69a-463c-a101-eaa781d84eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575979a5-c69a-463c-a101-eaa781d84eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895017878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861838cb-4b56-41cb-b4bc-27d97c5c7bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:59Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8b6ee3-b5bd-4f22-8b89-8fef62fb4db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c8b6ee3-b5bd-4f22-8b89-8fef62fb4db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c5267d-3bc2-400c-9726-fa6415d9f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c5267d-3bc2-400c-9726-fa6415d9f582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861838cb-4b56-41cb-b4bc-27d97c5c7bd3', 'volume_name': 'volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bb1a7d-0193-4eaf-8f3a-b784c09affd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bb1a7d-0193-4eaf-8f3a-b784c09affd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e2aa46-9108-4c2e-8742-c88ceeffa3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:58 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Volume 861838cb-4b56-41cb-b4bc-27d97c5c7bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3', 'volume_size': 1} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895017878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861838cb-4b56-41cb-b4bc-27d97c5c7bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:39:59Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Creating volume 861838cb-4b56-41cb-b4bc-27d97c5c7bd3 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:39:58 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:39:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:59 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71" returned: 0 in 0.393s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:39:59 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 1073741824 Sep 23 00:39:59 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[849e7a3d-f35c-4183-b769-d28f1c440c53]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:59 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf Sep 23 00:39:59 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:59 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 1073741824" returned: 0 in 0.437s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:59 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" returned: 0 in 0.403s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:59 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:59 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:59 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 Sep 23 00:39:59 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:39:59 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" returned: 0 in 0.253s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e2aa46-9108-4c2e-8742-c88ceeffa3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36d7c67-104e-4d9f-b571-bc05ef016e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:39:59 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Volume volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 (861838cb-4b56-41cb-b4bc-27d97c5c7bd3): created successfully Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c36d7c67-104e-4d9f-b571-bc05ef016e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (9f6783d3-e6b3-4260-ae0c-73fdcff0f92d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:39:59 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b8e396c4-c5d5-4cf3-8b50-e55d42abf24f tempest-ProjectMemberTests-665542472 None] Created volume successfully. Sep 23 00:39:59 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71" returned: 0 in 0.358s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:39:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:39:59 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71 Sep 23 00:39:59 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:00 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf.b89c2a55-67fa-4601-b141-2ec22b80dc71" returned: 0 in 0.280s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-b89c2a55-67fa-4601-b141-2ec22b80dc71" released by "_delete_snapshot" :: held 1.549s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" released by "delete_snapshot" :: held 1.575s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Creating offline snapshot fc88dc69-1ca5-45aa-8899-24f8dad7a31b of volume 861838cb-4b56-41cb-b4bc-27d97c5c7bd3 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7205f24b-85ec-4e1c-bf6d-56a6cc660226]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Created reservations ['7761c4fe-84ab-4574-b353-cc1363c984ef', '564738e3-c701-43ad-83e6-e0235335c0c5', 'ac5c14bf-e373-41fd-8826-cf063ed5ff84', 'ed0026de-fb43-4eba-bd1d-05896d0ca7e2', '1a551241-0774-47fc-8861-f377d9b3b8b5'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:00 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Delete snapshot completed successfully. Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-72d77d0b-7317-437f-9f2f-0212df5a3f3f tempest-ProjectReaderTests-618562035 None] Lock "cinder-b89c2a55-67fa-4601-b141-2ec22b80dc71-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:00 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 Sep 23 00:40:00 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:00 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" returned: 0 in 0.363s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:00 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b 1G Sep 23 00:40:00 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-2f2709d6-6710-48b0-9ba4-cc82a1646cdf-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Lock "cinder-2f2709d6-6710-48b0-9ba4-cc82a1646cdf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Acquiring lock "cinder-quobyte-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" acquired by "delete_volume" :: waited 0.014s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[867d67cb-4aaa-495f-9033-8e1c1f8e49e3]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:00 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf Sep 23 00:40:00 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:01 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b 1G" returned: 0 in 0.428s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:01 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b Sep 23 00:40:01 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:01 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" returned: 0 in 0.425s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:01 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf Sep 23 00:40:01 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:01 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b" returned: 0 in 0.309s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:01 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b is being set with open permissions: ugo+rw Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:01 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b Sep 23 00:40:01 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:01 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" returned: 0 in 0.258s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Lock "cinder-quobyte-2f2709d6-6710-48b0-9ba4-cc82a1646cdf" released by "delete_volume" :: held 0.749s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Created reservations ['b064f555-c4cb-44c4-9c3d-baa102c798ca', '800588be-c478-40f7-9a0e-3fdad41ca322', '1d39db00-360e-47e0-8703-b829a588cf45', 'cded7d58-92f4-4d45-a817-fd5338a4f505', '7c1e12af-bd6a-4e4d-8129-6eeeb25f51cb'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:01 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b" returned: 0 in 0.253s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:01 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.info Sep 23 00:40:01 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:01 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:01 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:01 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.info" returned: 0 in 0.281s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:01 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.info is being set with open permissions: ugo+rw Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:01 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.260s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:40:01 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.info Sep 23 00:40:01 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Deleted volume successfully. Sep 23 00:40:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-3b687953-71d6-46d8-a4a7-99a73018a791 tempest-ProjectReaderTests-618562035 None] Lock "cinder-2f2709d6-6710-48b0-9ba4-cc82a1646cdf-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:02 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.info" returned: 0 in 0.254s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:02 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0de301a5-20d6-409d-a1ee-91b044b50460 tempest-ProjectMemberTests-665542472 None] Create snapshot completed successfully Sep 23 00:40:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:40:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:02 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:02 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:03 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.248s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-fc88dc69-1ca5-45aa-8899-24f8dad7a31b-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Lock "cinder-fc88dc69-1ca5-45aa-8899-24f8dad7a31b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-fc88dc69-1ca5-45aa-8899-24f8dad7a31b" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-fc88dc69-1ca5-45aa-8899-24f8dad7a31b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Deleting offline snapshot fc88dc69-1ca5-45aa-8899-24f8dad7a31b of volume 861838cb-4b56-41cb-b4bc-27d97c5c7bd3 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] snapshot_file for this snap is: volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a014ff-428d-458e-bcda-b2cd36ebd14f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:03 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b Sep 23 00:40:03 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:03 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b" returned: 0 in 0.376s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e552f96-8f3c-49cc-bdb8-12cc45442413]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:03 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 Sep 23 00:40:03 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:04 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" returned: 0 in 0.377s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:04 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b Sep 23 00:40:04 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:04 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b" returned: 0 in 0.353s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:04 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b Sep 23 00:40:04 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:04 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:04 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3.fc88dc69-1ca5-45aa-8899-24f8dad7a31b" returned: 0 in 0.255s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-fc88dc69-1ca5-45aa-8899-24f8dad7a31b" released by "_delete_snapshot" :: held 1.468s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:04 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" released by "delete_snapshot" :: held 1.492s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:04 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Created reservations ['bfc5966e-023e-41f4-864a-0e0db1ad932c', 'd269b45d-8b9d-4c95-82fa-d22bbf5a86e0', '1a6780c4-f9f3-4f79-9858-e5b79a34249b', 'f4001a8b-4de9-4c24-b576-ede732235e9b', '7e0fd102-bc9b-4430-b3ab-a0ceb684f602'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:04 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Delete snapshot completed successfully. Sep 23 00:40:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-e3349df4-1af7-482b-9e3f-1a4ac47390fb tempest-ProjectMemberTests-665542472 None] Lock "cinder-fc88dc69-1ca5-45aa-8899-24f8dad7a31b-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-861838cb-4b56-41cb-b4bc-27d97c5c7bd3-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Lock "cinder-861838cb-4b56-41cb-b4bc-27d97c5c7bd3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:05 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" acquired by "delete_volume" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:05 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e402ad-80fb-4c39-8f42-f5da9365cf20]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:05 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 Sep 23 00:40:05 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:05 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" returned: 0 in 0.362s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:05 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:06 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3 Sep 23 00:40:06 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:06 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" returned: 0 in 0.261s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-861838cb-4b56-41cb-b4bc-27d97c5c7bd3" released by "delete_volume" :: held 0.687s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Created reservations ['db5b3635-7380-4da0-ba66-41cba2756dc0', '0558a193-58d4-4acd-9291-35f4f5984649', 'b1e39429-f02f-4f3c-b6ce-13c686b12cc6', '3f88ec91-4b75-4629-bb9d-ad1920a1dbb3', '7bd56bb3-dd8c-4404-aa58-cb4d840aaa44'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:06 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:06 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:06 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.265s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:40:06 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Deleted volume successfully. Sep 23 00:40:06 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-f701c7a4-e2e2-4199-974c-305373a1b274 tempest-ProjectMemberTests-665542472 None] Lock "cinder-861838cb-4b56-41cb-b4bc-27d97c5c7bd3-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (296b9360-1f59-438b-ae61-6b0450be41d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343a54f9-dae3-4211-a6ae-4df8b94ef2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343a54f9-dae3-4211-a6ae-4df8b94ef2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-708168662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1112d3a2-05fc-4a6f-ad4e-5d04e90ae740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:07Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0ecd0c-59e3-47c0-b1b6-9d4350efdd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0ecd0c-59e3-47c0-b1b6-9d4350efdd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b17538-296c-415c-b277-65c6d623465a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b17538-296c-415c-b277-65c6d623465a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1112d3a2-05fc-4a6f-ad4e-5d04e90ae740', 'volume_name': 'volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfe1ea6-65d2-4539-a1bc-92a860bc7237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfe1ea6-65d2-4539-a1bc-92a860bc7237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434051e2-4075-4ca8-aaac-6b6e9b6d658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:07 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Volume 1112d3a2-05fc-4a6f-ad4e-5d04e90ae740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740', 'volume_size': 1} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-708168662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1112d3a2-05fc-4a6f-ad4e-5d04e90ae740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:07Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Creating volume 1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:40:07 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:07 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 1073741824 Sep 23 00:40:07 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:07 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 1073741824" returned: 0 in 0.481s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:07 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:07 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 Sep 23 00:40:07 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:08 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" returned: 0 in 0.239s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434051e2-4075-4ca8-aaac-6b6e9b6d658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b814db98-5cda-45be-a8ed-b8e61c87220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:08 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Volume volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 (1112d3a2-05fc-4a6f-ad4e-5d04e90ae740): created successfully Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b814db98-5cda-45be-a8ed-b8e61c87220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (296b9360-1f59-438b-ae61-6b0450be41d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:08 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-e2fcedc7-3ddd-42c5-a380-02018578db40 tempest-ProjectMemberTests-665542472 None] Created volume successfully. Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Creating offline snapshot fbef7984-ae5e-4d80-bfa5-e2db5b566761 of volume 1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef9bade-d0c0-4e9f-99c4-bafb5a881b27]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:08 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 Sep 23 00:40:08 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:08 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" returned: 0 in 0.369s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:08 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:08 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 1G Sep 23 00:40:08 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:09 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 1G" returned: 0 in 0.443s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:09 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 Sep 23 00:40:09 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:09 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761" returned: 0 in 0.325s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:09 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 is being set with open permissions: ugo+rw Sep 23 00:40:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:09 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 Sep 23 00:40:09 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:09 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761" returned: 0 in 0.239s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:09 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:09 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.info Sep 23 00:40:09 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:10 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.info" returned: 0 in 0.244s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:10 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.info is being set with open permissions: ugo+rw Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:10 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.info Sep 23 00:40:10 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:10 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.info" returned: 0 in 0.254s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:10 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-aecf8b5e-05da-48f1-910c-3a3b411e6755 tempest-ProjectMemberTests-665542472 None] Create snapshot completed successfully Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-fbef7984-ae5e-4d80-bfa5-e2db5b566761-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Lock "cinder-fbef7984-ae5e-4d80-bfa5-e2db5b566761-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-fbef7984-ae5e-4d80-bfa5-e2db5b566761" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-fbef7984-ae5e-4d80-bfa5-e2db5b566761" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Deleting offline snapshot fbef7984-ae5e-4d80-bfa5-e2db5b566761 of volume 1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] snapshot_file for this snap is: volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45efae0-30fa-4c74-8d28-bcbf054ff658]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:10 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:10 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 Sep 23 00:40:10 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:11 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761" returned: 0 in 0.376s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:11 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:40:11 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd4240f-a437-47b9-8c51-e9469c8696ca]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:11 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 Sep 23 00:40:11 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:11 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" returned: 0 in 0.385s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:11 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 Sep 23 00:40:11 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:11 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761" returned: 0 in 0.371s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:11 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:11 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761 Sep 23 00:40:11 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:12 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740.fbef7984-ae5e-4d80-bfa5-e2db5b566761" returned: 0 in 0.291s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-fbef7984-ae5e-4d80-bfa5-e2db5b566761" released by "_delete_snapshot" :: held 1.537s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" released by "delete_snapshot" :: held 1.571s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Created reservations ['32f02cea-eac2-4fda-815d-5887e5f4ca0c', '59167baa-d9df-4db7-8893-05460e244a74', '11d172ab-7ede-4aad-ab82-1eaa5cd1b9b2', '73d1fadd-97de-4170-9b69-6951be8fad65', '3db6ba33-120c-4fb5-a223-30566058e929'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:12 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Delete snapshot completed successfully. Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-aa9bf93b-8595-46e3-853b-37d61f3655a6 tempest-ProjectMemberTests-665542472 None] Lock "cinder-fbef7984-ae5e-4d80-bfa5-e2db5b566761-delete_snapshot" released by "delete_snapshot" :: held 1.742s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Lock "cinder-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" acquired by "delete_volume" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d9c0f1-6f6e-402a-b6c4-ad5eb78138a2]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:12 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:13 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 Sep 23 00:40:13 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:13 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" returned: 0 in 0.402s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:13 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740 Sep 23 00:40:13 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:13 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" returned: 0 in 0.269s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740" released by "delete_volume" :: held 0.741s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Created reservations ['1dc0e68f-a412-4ae0-9a54-d0c3d27a9369', 'd3724c20-2de1-4327-ae46-605354a6076d', '9551f530-f2a9-4272-bef9-6be1065a27a0', '02d24d72-a829-4396-be1b-e4a99770212d', '20a3b7a0-de86-47a4-9a7f-00e8e3761fd2'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:13 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:13 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:13 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:14 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.289s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:40:14 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Deleted volume successfully. Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4eaf9b56-1f36-475d-8d50-5cb6726f307f tempest-ProjectMemberTests-665542472 None] Lock "cinder-1112d3a2-05fc-4a6f-ad4e-5d04e90ae740-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (43c1e4d2-4f29-40f5-9671-58d8b8f1484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99c2b69-27e3-4080-9083-a706221e311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99c2b69-27e3-4080-9083-a706221e311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538782379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c5504e-6284-443d-840e-88ab6ff76df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:14Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecd9d5c-2dc3-44f6-958d-14f9c8ea6cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecd9d5c-2dc3-44f6-958d-14f9c8ea6cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa2969c-23d2-4e44-8e41-9e4c6e517486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa2969c-23d2-4e44-8e41-9e4c6e517486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c5504e-6284-443d-840e-88ab6ff76df1', 'volume_name': 'volume-95c5504e-6284-443d-840e-88ab6ff76df1', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e123395-4d2f-4c0b-a016-9eb03c50923f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e123395-4d2f-4c0b-a016-9eb03c50923f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17030e9-9752-40d9-b2ef-94a526d5bf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:14 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Volume 95c5504e-6284-443d-840e-88ab6ff76df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c5504e-6284-443d-840e-88ab6ff76df1', 'volume_size': 1} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538782379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c5504e-6284-443d-840e-88ab6ff76df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b597d30ef16a43a29c0ada95cf8ad237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:14Z,use_quota=True,user_id='394fbbb43cf54c52857e2d93b548df02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Creating volume 95c5504e-6284-443d-840e-88ab6ff76df1 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:40:14 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:40:14 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:14 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 1073741824 Sep 23 00:40:14 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:15 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 1073741824" returned: 0 in 0.472s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:15 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 Sep 23 00:40:15 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:15 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1" returned: 0 in 0.259s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:15 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:40:15 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17030e9-9752-40d9-b2ef-94a526d5bf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c5504e-6284-443d-840e-88ab6ff76df1', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0377fb47-6d9d-4ce9-b845-fc36a081aa74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:15 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Volume volume-95c5504e-6284-443d-840e-88ab6ff76df1 (95c5504e-6284-443d-840e-88ab6ff76df1): created successfully Sep 23 00:40:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0377fb47-6d9d-4ce9-b845-fc36a081aa74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:15 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Flow 'volume_create_manager' (43c1e4d2-4f29-40f5-9671-58d8b8f1484c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:15 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8eb30a83-64ad-4fc4-b30e-a85036aab281 tempest-ProjectMemberTests-665542472 None] Created volume successfully. Sep 23 00:40:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:16 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Creating offline snapshot 28b950d3-5c1b-4302-b940-fb874919bb12 of volume 95c5504e-6284-443d-840e-88ab6ff76df1 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:40:16 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0e2637-aa1a-460c-8aca-7bb65359a5df]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:16 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:16 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 Sep 23 00:40:16 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:17 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1" returned: 0 in 0.399s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:17 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 1G Sep 23 00:40:17 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:17 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 1G" returned: 0 in 0.430s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c5504e-6284-443d-840e-88ab6ff76df1 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:17 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c5504e-6284-443d-840e-88ab6ff76df1 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 Sep 23 00:40:17 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:17 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95c5504e-6284-443d-840e-88ab6ff76df1 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12" returned: 0 in 0.304s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:17 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 is being set with open permissions: ugo+rw Sep 23 00:40:17 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:17 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 Sep 23 00:40:17 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:18 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12" returned: 0 in 0.255s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:18 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.info Sep 23 00:40:18 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:18 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.info" returned: 0 in 0.267s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:18 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.info is being set with open permissions: ugo+rw Sep 23 00:40:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:18 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.info Sep 23 00:40:18 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:18 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.info" returned: 0 in 0.239s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:18 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:18 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-16e4e08e-f705-44ac-af0a-909a813f6bb8 tempest-ProjectMemberTests-665542472 None] Create snapshot completed successfully Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-28b950d3-5c1b-4302-b940-fb874919bb12-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Lock "cinder-28b950d3-5c1b-4302-b940-fb874919bb12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-95c5504e-6284-443d-840e-88ab6ff76df1" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-95c5504e-6284-443d-840e-88ab6ff76df1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-28b950d3-5c1b-4302-b940-fb874919bb12" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-28b950d3-5c1b-4302-b940-fb874919bb12" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Deleting offline snapshot 28b950d3-5c1b-4302-b940-fb874919bb12 of volume 95c5504e-6284-443d-840e-88ab6ff76df1 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] snapshot_file for this snap is: volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[737dd534-086d-46bc-8f5a-da9952583d39]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:19 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 Sep 23 00:40:19 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:19 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12" returned: 0 in 0.401s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95c5504e-6284-443d-840e-88ab6ff76df1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21b4ff4-cb99-4b80-9c38-edd0178c89a9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:19 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 Sep 23 00:40:19 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:19 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1" returned: 0 in 0.386s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:19 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:19 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 Sep 23 00:40:19 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:20 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12" returned: 0 in 0.386s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:20 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12 Sep 23 00:40:20 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:20 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:20 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1.28b950d3-5c1b-4302-b940-fb874919bb12" returned: 0 in 0.254s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-28b950d3-5c1b-4302-b940-fb874919bb12" released by "_delete_snapshot" :: held 1.551s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-95c5504e-6284-443d-840e-88ab6ff76df1" released by "delete_snapshot" :: held 1.576s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:20 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Created reservations ['5ecff046-dd84-4f15-92fa-25c6e4495ee1', 'e0aedcac-ff3c-4451-a62d-c6f49873a559', '5d9010aa-3eed-4cd0-993f-c254fe78d13c', '2ec154ca-c048-4958-b899-c4c0c943a77d', '281bf685-2f54-4c95-b8e8-3d29b67efd11'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:20 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Delete snapshot completed successfully. Sep 23 00:40:20 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-ee67e948-cb6d-414d-ac5b-dbcc4db3b7da tempest-ProjectMemberTests-665542472 None] Lock "cinder-28b950d3-5c1b-4302-b940-fb874919bb12-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-95c5504e-6284-443d-840e-88ab6ff76df1-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Lock "cinder-95c5504e-6284-443d-840e-88ab6ff76df1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:21 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=229,cinder:SELECT=183,cinder:INSERT=73,cinder:DELETE=20 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:40:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Acquiring lock "cinder-quobyte-95c5504e-6284-443d-840e-88ab6ff76df1" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:21 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-95c5504e-6284-443d-840e-88ab6ff76df1" acquired by "delete_volume" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:21 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b40062-d26b-4cfa-ac03-ce4d20801791]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:21 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 Sep 23 00:40:21 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:21 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1" returned: 0 in 0.389s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:21 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:21 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1 Sep 23 00:40:21 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:21 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-95c5504e-6284-443d-840e-88ab6ff76df1" returned: 0 in 0.252s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Lock "cinder-quobyte-95c5504e-6284-443d-840e-88ab6ff76df1" released by "delete_volume" :: held 0.712s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Created reservations ['ffec7068-1af6-414f-a9b1-ee6f8da268d7', '1ee1e56b-6023-43cc-a79e-95bfd171244a', 'b6238c3c-7f1d-4ca3-bed4-4f3e0126f3a9', '1f363e00-a326-4375-bc24-dbed5b228f2c', 'fa7e9afa-911b-4e16-b0ae-ccd355f0a0ca'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:22 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:22 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:22 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.260s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:40:22 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Deleted volume successfully. Sep 23 00:40:22 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-1b47889a-47b7-4d43-8fb7-d9542f70b421 tempest-ProjectMemberTests-665542472 None] Lock "cinder-95c5504e-6284-443d-840e-88ab6ff76df1-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:32 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:40:32 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:UPDATE=243,cinder:SELECT=191,cinder:INSERT=70,cinder:DELETE=14 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Flow 'volume_create_manager' (494e549c-63ef-4ef4-bf01-343608054b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19daf418-f3ad-42ea-b6cc-bab436a90917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19daf418-f3ad-42ea-b6cc-bab436a90917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259463785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864322a5-b1c5-49d3-9b39-0e08342bfbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb01f0a2f4c84c2f92b331ff889b3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:34Z,use_quota=True,user_id='58a11dba74df416081bf1ecea1babdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7543f66-21f7-4b6e-927a-8537f7ac954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7543f66-21f7-4b6e-927a-8537f7ac954d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a878739c-8d27-48b0-aa16-55bce9035a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a878739c-8d27-48b0-aa16-55bce9035a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864322a5-b1c5-49d3-9b39-0e08342bfbf6', 'volume_name': 'volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b96c65-0301-4d71-837f-630415b6fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b96c65-0301-4d71-837f-630415b6fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c2ea59-ccc8-4cdb-87fb-4a3ad512c34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:34 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Volume 864322a5-b1c5-49d3-9b39-0e08342bfbf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6', 'volume_size': 1} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259463785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864322a5-b1c5-49d3-9b39-0e08342bfbf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb01f0a2f4c84c2f92b331ff889b3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:34Z,use_quota=True,user_id='58a11dba74df416081bf1ecea1babdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Creating volume 864322a5-b1c5-49d3-9b39-0e08342bfbf6 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:40:34 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:34 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 1073741824 Sep 23 00:40:34 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:34 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 1073741824" returned: 0 in 0.518s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:34 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:34 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 Sep 23 00:40:34 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:35 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6" returned: 0 in 0.266s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:35 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:40:35 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c2ea59-ccc8-4cdb-87fb-4a3ad512c34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d197a8-92c9-4ab5-988d-08c0bcc095f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:35 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Volume volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 (864322a5-b1c5-49d3-9b39-0e08342bfbf6): created successfully Sep 23 00:40:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d197a8-92c9-4ab5-988d-08c0bcc095f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:35 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Flow 'volume_create_manager' (494e549c-63ef-4ef4-bf01-343608054b78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:35 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-0eb59524-7a8b-4acc-baf0-4cb7696e7524 tempest-ProjectReaderTests-70011544 None] Created volume successfully. Sep 23 00:40:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Acquiring lock "cinder-864322a5-b1c5-49d3-9b39-0e08342bfbf6-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Lock "cinder-864322a5-b1c5-49d3-9b39-0e08342bfbf6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Acquiring lock "cinder-quobyte-864322a5-b1c5-49d3-9b39-0e08342bfbf6" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:36 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Lock "cinder-quobyte-864322a5-b1c5-49d3-9b39-0e08342bfbf6" acquired by "delete_volume" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:36 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca778ca8-95bd-42e6-98d9-37bfae60ee0b]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:36 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:36 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 Sep 23 00:40:36 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:37 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6" returned: 0 in 0.386s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:37 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6 Sep 23 00:40:37 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:37 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-864322a5-b1c5-49d3-9b39-0e08342bfbf6" returned: 0 in 0.275s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Lock "cinder-quobyte-864322a5-b1c5-49d3-9b39-0e08342bfbf6" released by "delete_volume" :: held 0.707s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Created reservations ['486deab9-221a-43b0-ae03-72100de8fa2f', '90a15626-fd71-4dd4-ab05-e41487853984', 'f7d58f43-5cd9-40ce-b17e-d17444032425', '058ea9d6-5b1d-4ae6-8908-42040bec5d4a', '03225aa8-0725-4611-ac9e-f970d49714e5'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:37 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:37 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:37 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.281s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:40:37 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Deleted volume successfully. Sep 23 00:40:37 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4c9953b1-4ef9-4e01-bad3-cb309c62307e tempest-ProjectReaderTests-70011544 None] Lock "cinder-864322a5-b1c5-49d3-9b39-0e08342bfbf6-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Flow 'volume_create_manager' (6630e0cf-711a-4113-be57-cde511242502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78881d7b-0c1a-4ccc-9d0a-17115733f64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78881d7b-0c1a-4ccc-9d0a-17115733f64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421702175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d05180-2ec0-4afa-a145-53ea54cf2e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb01f0a2f4c84c2f92b331ff889b3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:38Z,use_quota=True,user_id='58a11dba74df416081bf1ecea1babdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145e530-4a23-47bb-99d2-430f410ad7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f145e530-4a23-47bb-99d2-430f410ad7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5180f748-5994-496c-a245-fb7d33bad5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5180f748-5994-496c-a245-fb7d33bad5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d05180-2ec0-4afa-a145-53ea54cf2e5d', 'volume_name': 'volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501b910a-6717-4a86-a197-f642d98e8d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501b910a-6717-4a86-a197-f642d98e8d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c777bb18-8d25-4535-bf08-ceb3ce6b41e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:38 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Volume 90d05180-2ec0-4afa-a145-53ea54cf2e5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d', 'volume_size': 1} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1421702175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d05180-2ec0-4afa-a145-53ea54cf2e5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb01f0a2f4c84c2f92b331ff889b3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:38Z,use_quota=True,user_id='58a11dba74df416081bf1ecea1babdb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Creating volume 90d05180-2ec0-4afa-a145-53ea54cf2e5d {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:40:38 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:38 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d 1073741824 Sep 23 00:40:38 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:38 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d 1073741824" returned: 0 in 0.486s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:38 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:38 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d Sep 23 00:40:38 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:39 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d" returned: 0 in 0.256s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:39 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:40:39 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c777bb18-8d25-4535-bf08-ceb3ce6b41e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9840bab-a0db-484a-bf17-6a0c194812f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:39 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Volume volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d (90d05180-2ec0-4afa-a145-53ea54cf2e5d): created successfully Sep 23 00:40:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9840bab-a0db-484a-bf17-6a0c194812f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:39 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Flow 'volume_create_manager' (6630e0cf-711a-4113-be57-cde511242502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:39 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-a590a0ed-0062-495c-8406-bce482741e54 tempest-ProjectReaderTests-70011544 None] Created volume successfully. Sep 23 00:40:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Acquiring lock "cinder-90d05180-2ec0-4afa-a145-53ea54cf2e5d-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Lock "cinder-90d05180-2ec0-4afa-a145-53ea54cf2e5d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Acquiring lock "cinder-quobyte-90d05180-2ec0-4afa-a145-53ea54cf2e5d" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:40 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Lock "cinder-quobyte-90d05180-2ec0-4afa-a145-53ea54cf2e5d" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:40 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[61229fc2-e352-4e23-a7c2-ab01739de224]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:40 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d Sep 23 00:40:40 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:40 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d" returned: 0 in 0.458s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:40 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:41 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d Sep 23 00:40:41 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:41 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-90d05180-2ec0-4afa-a145-53ea54cf2e5d" returned: 0 in 0.276s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Lock "cinder-quobyte-90d05180-2ec0-4afa-a145-53ea54cf2e5d" released by "delete_volume" :: held 0.797s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Created reservations ['422e86c3-2497-46fa-ac9f-79ce7e5ba342', '663a9beb-fd31-42be-aba2-0766ad5ffee7', '35076d29-1716-412d-9d7c-e279140bdcda', 'ba0f056f-6800-4d29-8ea4-1b062259e1e6', 'cdb53e77-2755-4b60-a642-61d23da45773'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:41 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:41 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:41 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.325s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:40:41 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Deleted volume successfully. Sep 23 00:40:41 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-6a984b44-23dd-4f67-becc-c9f0a362af0e tempest-ProjectReaderTests-70011544 None] Lock "cinder-90d05180-2ec0-4afa-a145-53ea54cf2e5d-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Flow 'volume_create_manager' (56e411c3-9e4f-4057-837b-e28c1eedd516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826abb8e-cafc-4db1-b9cb-5b7f36246cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826abb8e-cafc-4db1-b9cb-5b7f36246cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1442784702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3dde9a-4703-4d47-b730-ffc93129ffb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fd0ec062cc4409b57fe63cad1b9741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:44Z,use_quota=True,user_id='25346def030841cfa935604d809f69f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafb1f56-6559-4279-8eba-ef4f18b1a4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafb1f56-6559-4279-8eba-ef4f18b1a4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305a4a7e-0c69-413d-9a02-2218f83cb069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305a4a7e-0c69-413d-9a02-2218f83cb069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b3dde9a-4703-4d47-b730-ffc93129ffb5', 'volume_name': 'volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca70b10-23f0-4462-b3bd-be310902a9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca70b10-23f0-4462-b3bd-be310902a9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab1ba4a-db3d-4165-a5ba-a375a1797750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:44 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Volume 5b3dde9a-4703-4d47-b730-ffc93129ffb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5', 'volume_size': 1} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1442784702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b3dde9a-4703-4d47-b730-ffc93129ffb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fd0ec062cc4409b57fe63cad1b9741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:44Z,use_quota=True,user_id='25346def030841cfa935604d809f69f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Creating volume 5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:40:44 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:44 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 1073741824 Sep 23 00:40:44 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:44 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 1073741824" returned: 0 in 0.453s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:44 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:44 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 Sep 23 00:40:44 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:45 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5" returned: 0 in 0.256s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ab1ba4a-db3d-4165-a5ba-a375a1797750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cb8e0e-0761-4f5c-894a-e224104022ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Volume volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 (5b3dde9a-4703-4d47-b730-ffc93129ffb5): created successfully Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10cb8e0e-0761-4f5c-894a-e224104022ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Flow 'volume_create_manager' (56e411c3-9e4f-4057-837b-e28c1eedd516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:45 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-177717ea-3b64-4d7e-a3c6-bc52d2c985f0 tempest-SnapshotDependencyTests-2009516681 None] Created volume successfully. Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Flow 'volume_create_manager' (898e58f9-bb4e-4fe9-a4fb-fec9f0aa8c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe20eab-3b8d-4f44-960d-0367bc2fb13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fe20eab-3b8d-4f44-960d-0367bc2fb13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285983218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1d4cacae404b3aaa28d623faac106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:46Z,use_quota=True,user_id='91d71dd111914a188fd53a84d205aeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40375293-64f2-4541-b772-f80bd8ceb7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40375293-64f2-4541-b772-f80bd8ceb7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08276c2-6e7a-499c-9663-6af18fa11d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08276c2-6e7a-499c-9663-6af18fa11d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf', 'volume_name': 'volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b930612-e63d-4779-bcae-f87cb5ecb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b930612-e63d-4779-bcae-f87cb5ecb601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46557c3d-32b0-4ea0-b72e-1cce8151e589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:45 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Volume 1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf', 'volume_size': 1} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285983218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1d4cacae404b3aaa28d623faac106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:46Z,use_quota=True,user_id='91d71dd111914a188fd53a84d205aeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Creating volume 1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:40:45 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:40:45 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:45 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf 1073741824 Sep 23 00:40:45 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:46 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf 1073741824" returned: 0 in 0.407s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:46 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf Sep 23 00:40:46 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:46 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf" returned: 0 in 0.258s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46557c3d-32b0-4ea0-b72e-1cce8151e589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fdf86a-27e4-4f83-9112-5c9565d4a1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:46 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Volume volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf (1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf): created successfully Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99fdf86a-27e4-4f83-9112-5c9565d4a1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Flow 'volume_create_manager' (898e58f9-bb4e-4fe9-a4fb-fec9f0aa8c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:46 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-dcf1f642-9039-4c4b-b931-c58663abdd79 tempest-ProjectReaderTests-1920914117 None] Created volume successfully. Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Creating offline snapshot 80e65e1e-5c34-4928-9ccb-064f596f43f7 of volume 5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e96e3ae-d295-4eff-ba30-4656d55c1974]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:46 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 Sep 23 00:40:46 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "cinder-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "cinder-quobyte-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-quobyte-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf" acquired by "delete_volume" :: waited 0.017s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbac8295-16f0-42eb-8ec5-649ee180d1a9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:46 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:47 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:47 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf Sep 23 00:40:47 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5" returned: 0 in 0.396s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 1G {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:47 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 1G Sep 23 00:40:47 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:47 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf" returned: 0 in 0.387s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:47 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf Sep 23 00:40:47 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:47 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 1G" returned: 0 in 0.403s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:47 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 Sep 23 00:40:47 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:47 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf" returned: 0 in 0.285s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-quobyte-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf" released by "delete_volume" :: held 0.732s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Created reservations ['f669793c-b701-4996-81e4-6d450a7c0485', '9be60959-611a-4a84-896a-809df7300291', 'ef9a4923-4217-479d-a2b9-a62a1c55ebf5', 'ac160847-6006-495e-9286-4589e82adc5e', '5d1eaa0d-fee6-43ef-85db-7f673b9018c4'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:47 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 -F qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7" returned: 0 in 0.324s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:47 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 is being set with open permissions: ugo+rw Sep 23 00:40:47 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:47 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:47 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:47 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 Sep 23 00:40:47 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:48 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.270s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:40:48 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Deleted volume successfully. Sep 23 00:40:48 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7" returned: 0 in 0.275s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-99524d1a-1432-4ba3-a9fc-d917a3cfefc0 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-1d88504e-9dd5-46e5-bbf9-e3cc7a3840bf-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:48 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.info Sep 23 00:40:48 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:48 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.info" returned: 0 in 0.290s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:48 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.info is being set with open permissions: ugo+rw Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.info {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:48 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.info Sep 23 00:40:48 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Flow 'volume_create_manager' (fe3b8726-e1c4-40dd-9acb-bf19a776722e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e27a0d-bb2f-4eeb-8db2-8cf269c232a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e27a0d-bb2f-4eeb-8db2-8cf269c232a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-812921310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1d4cacae404b3aaa28d623faac106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:48Z,use_quota=True,user_id='91d71dd111914a188fd53a84d205aeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09253459-9bf8-4329-924d-83cf8b871731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09253459-9bf8-4329-924d-83cf8b871731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b11bd9a-305e-4592-b802-e9faaa6f89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b11bd9a-305e-4592-b802-e9faaa6f89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d', 'volume_name': 'volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fd9074-75c0-45de-b10f-016672c395cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fd9074-75c0-45de-b10f-016672c395cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716028cf-83d1-4a7e-977f-fc73dc0aa0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:48 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Volume 2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d', 'volume_size': 1} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:48 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.info" returned: 0 in 0.254s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.093s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-812921310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1d4cacae404b3aaa28d623faac106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:48Z,use_quota=True,user_id='91d71dd111914a188fd53a84d205aeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Creating volume 2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:40:48 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:40:48 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:48 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d 1073741824 Sep 23 00:40:48 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:48 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-48cec508-1339-4d5d-8c67-e2f43796c58d tempest-SnapshotDependencyTests-2009516681 None] Create snapshot completed successfully Sep 23 00:40:49 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d 1073741824" returned: 0 in 0.414s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:49 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d Sep 23 00:40:49 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:49 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d" returned: 0 in 0.251s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:49 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:40:49 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716028cf-83d1-4a7e-977f-fc73dc0aa0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f841cea6-4f93-45c3-9255-4ca21de49acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:49 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Volume volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d (2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d): created successfully Sep 23 00:40:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f841cea6-4f93-45c3-9255-4ca21de49acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:49 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Flow 'volume_create_manager' (fe3b8726-e1c4-40dd-9acb-bf19a776722e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:49 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b51a3cbf-c595-4274-9fa8-d156a6c46e8b tempest-ProjectReaderTests-1920914117 None] Created volume successfully. Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Flow 'volume_create_manager' (e3456b15-4063-4e4b-9114-f73879757ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c35a1d-4cf6-407c-a19b-55a6e5a32146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7c35a1d-4cf6-407c-a19b-55a6e5a32146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac76ca6-13c6-4432-8e28-6a8f707d75fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fd0ec062cc4409b57fe63cad1b9741',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80e65e1e-5c34-4928-9ccb-064f596f43f7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:50Z,use_quota=True,user_id='25346def030841cfa935604d809f69f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2caaae5e-0692-4226-a3c4-8313ce661d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2caaae5e-0692-4226-a3c4-8313ce661d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db62bb4-946d-4396-9539-3086c565c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8db62bb4-946d-4396-9539-3086c565c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ac76ca6-13c6-4432-8e28-6a8f707d75fb', 'volume_name': 'volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb', 'volume_size': 1, 'snapshot_id': '80e65e1e-5c34-4928-9ccb-064f596f43f7'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fa7332-f9b3-47a8-8888-93c4e7d6f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fa7332-f9b3-47a8-8888-93c4e7d6f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4654808-4828-4cd7-a077-18fae32ad88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:50 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Volume 2ac76ca6-13c6-4432-8e28-6a8f707d75fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb', 'volume_size': 1, 'snapshot_id': '80e65e1e-5c34-4928-9ccb-064f596f43f7'} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "cinder-quobyte-80e65e1e-5c34-4928-9ccb-064f596f43f7-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" by "_create_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-80e65e1e-5c34-4928-9ccb-064f596f43f7-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Creating volume 2ac76ca6-13c6-4432-8e28-6a8f707d75fb from snapshot 80e65e1e-5c34-4928-9ccb-064f596f43f7 {{(pid=87138) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "cinder-quobyte-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" by "_copy_volume_from_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] snapshot: 80e65e1e-5c34-4928-9ccb-064f596f43f7, volume: 2ac76ca6-13c6-4432-8e28-6a8f707d75fb, {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4050785-2c71-4755-a3f0-0f85972e6a6a]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:50 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 Sep 23 00:40:50 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "cinder-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "cinder-quobyte-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-quobyte-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af88165-1bae-4366-b315-0267c7ba9dca]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:50 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d Sep 23 00:40:50 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:50 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7" returned: 0 in 0.373s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad1502a-d178-4a22-910e-cd58a3036813]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:50 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:50 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 Sep 23 00:40:50 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:51 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d" returned: 0 in 0.371s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:51 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d Sep 23 00:40:51 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:51 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5" returned: 0 in 0.397s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Creating direct copy from snapshot {{(pid=87138) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG cinder.utils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Path /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb not found in is_blk_device check {{(pid=87138) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:51 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb Sep 23 00:40:51 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:51 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d" returned: 0 in 0.286s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-quobyte-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d" released by "delete_volume" :: held 0.710s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Created reservations ['9d6ff5cb-3312-4d24-b047-de907316be4a', 'fccc0895-9960-4a68-aeb5-857eb23fe676', '13f4f77b-39b1-4b75-9593-8750e30f6ab8', '696080d0-e68e-44b9-a277-85f78788953c', '9ea24f9b-3664-4841-8125-f56d4d16fa55'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:51 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:51 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:51 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.313s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:40:51 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Deleted volume successfully. Sep 23 00:40:51 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-d75da8c1-ae0d-4e8f-bc6d-f472721a8b90 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-2d2530ff-ac0a-46d9-8e2b-4f752bd28d8d-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Flow 'volume_create_manager' (7d01faf9-5ff3-4288-bc5d-51704a4174db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77687d7b-74c2-42e9-884b-c3d0b947c739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77687d7b-74c2-42e9-884b-c3d0b947c739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173405164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10fa951-2257-4e26-8e07-3f342df808ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1d4cacae404b3aaa28d623faac106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:52Z,use_quota=True,user_id='91d71dd111914a188fd53a84d205aeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb877323-38c1-4624-be68-3a60da407e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb877323-38c1-4624-be68-3a60da407e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4eb63c2-387c-45c7-bf6d-792f2b0056e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4eb63c2-387c-45c7-bf6d-792f2b0056e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10fa951-2257-4e26-8e07-3f342df808ca', 'volume_name': 'volume-e10fa951-2257-4e26-8e07-3f342df808ca', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d31b356-fd3e-42e9-8f66-5c96947f35cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d31b356-fd3e-42e9-8f66-5c96947f35cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f56f05-082f-4033-996b-f761afcae586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:52 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Volume e10fa951-2257-4e26-8e07-3f342df808ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10fa951-2257-4e26-8e07-3f342df808ca', 'volume_size': 1} Sep 23 00:40:52 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:57 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" returned: 0 in 6.217s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.image.image_utils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Image conversion details: src /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb {{(pid=87138) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 23 00:40:57 devstack cinder-volume[87138]: INFO cinder.image.image_utils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Converted 1024.00 MB image at 164.68 MB/s Sep 23 00:40:57 devstack cinder-volume[87138]: WARNING cinder.volume.drivers.remotefs [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb is being set with open permissions: ugo+rw Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:57 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb Sep 23 00:40:57 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:57 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" returned: 0 in 0.237s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" released by "_copy_volume_from_snapshot" :: held 7.320s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-80e65e1e-5c34-4928-9ccb-064f596f43f7-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" released by "_create_volume_from_snapshot" :: held 7.374s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.389s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.993s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1173405164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10fa951-2257-4e26-8e07-3f342df808ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1d4cacae404b3aaa28d623faac106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:40:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:40:52Z,use_quota=True,user_id='91d71dd111914a188fd53a84d205aeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Creating volume e10fa951-2257-4e26-8e07-3f342df808ca {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:40:57 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:57 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca 1073741824 Sep 23 00:40:57 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4654808-4828-4cd7-a077-18fae32ad88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb', 'volume_size': 1, 'snapshot_id': '80e65e1e-5c34-4928-9ccb-064f596f43f7'}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd06c9d9-1d0d-4ca2-a858-4071ad4a3fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:57 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Volume volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb (2ac76ca6-13c6-4432-8e28-6a8f707d75fb): created successfully Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd06c9d9-1d0d-4ca2-a858-4071ad4a3fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:57 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Flow 'volume_create_manager' (e3456b15-4063-4e4b-9114-f73879757ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:57 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5a9e8c10-e80e-4cb9-a849-a6270be4fb28 tempest-SnapshotDependencyTests-2009516681 None] Created volume successfully. Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "cinder-80e65e1e-5c34-4928-9ccb-064f596f43f7-delete_snapshot" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-80e65e1e-5c34-4928-9ccb-064f596f43f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "cinder-quobyte-5b3dde9a-4703-4d47-b730-ffc93129ffb5" by "delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-5b3dde9a-4703-4d47-b730-ffc93129ffb5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "cinder-quobyte-80e65e1e-5c34-4928-9ccb-064f596f43f7" by "_delete_snapshot" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-80e65e1e-5c34-4928-9ccb-064f596f43f7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Deleting offline snapshot 80e65e1e-5c34-4928-9ccb-064f596f43f7 of volume 5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] snapshot_file for this snap is: volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 {{(pid=87138) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e93b14-8bb5-4183-bc40-15c10d380117]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:58 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 Sep 23 00:40:58 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:58 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca 1073741824" returned: 0 in 0.456s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:58 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca Sep 23 00:40:58 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:58 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7" returned: 0 in 0.364s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87138) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[f816e4cb-62c5-4895-b007-73667694121c]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:58 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca" returned: 0 in 0.264s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f56f05-082f-4033-996b-f761afcae586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10fa951-2257-4e26-8e07-3f342df808ca', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d561b700-f240-4f1a-b9d9-9acd4d776066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:40:58 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Volume volume-e10fa951-2257-4e26-8e07-3f342df808ca (e10fa951-2257-4e26-8e07-3f342df808ca): created successfully Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d561b700-f240-4f1a-b9d9-9acd4d776066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:40:58 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Flow 'volume_create_manager' (7d01faf9-5ff3-4288-bc5d-51704a4174db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:40:58 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-6d65ac45-36fc-4539-9446-41a38761ab0e tempest-ProjectReaderTests-1920914117 None] Created volume successfully. Sep 23 00:40:58 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 Sep 23 00:40:58 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:59 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5" returned: 0 in 0.537s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:59 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 Sep 23 00:40:59 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "cinder-e10fa951-2257-4e26-8e07-3f342df808ca-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-e10fa951-2257-4e26-8e07-3f342df808ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "cinder-quobyte-e10fa951-2257-4e26-8e07-3f342df808ca" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-quobyte-e10fa951-2257-4e26-8e07-3f342df808ca" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a5531d-a458-41ed-a136-1f4ba0216e3f]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:59 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca Sep 23 00:40:59 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:59 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7" returned: 0 in 0.364s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:59 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7 Sep 23 00:40:59 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:59 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca" returned: 0 in 0.357s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:59 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca Sep 23 00:40:59 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:40:59 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5.80e65e1e-5c34-4928-9ccb-064f596f43f7" returned: 0 in 0.256s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-80e65e1e-5c34-4928-9ccb-064f596f43f7" released by "_delete_snapshot" :: held 1.627s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-5b3dde9a-4703-4d47-b730-ffc93129ffb5" released by "delete_snapshot" :: held 1.655s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Created reservations ['5050cf58-837a-43c9-ab91-66400bdcc4c1', '8907f980-4434-4e4c-bf77-5de6cfc635e2', '76c5d314-1ee1-4f35-8698-d537aa6954c0', '4a6c5747-3d58-4960-b263-6f1523eef111', '510ac65b-5d47-49c8-a439-d573fde9376d'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:59 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Delete snapshot completed successfully. Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-5a4fa359-c46a-4001-8d1f-effa2aa4d671 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-80e65e1e-5c34-4928-9ccb-064f596f43f7-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:59 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-e10fa951-2257-4e26-8e07-3f342df808ca" returned: 0 in 0.253s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-quobyte-e10fa951-2257-4e26-8e07-3f342df808ca" released by "delete_volume" :: held 0.652s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Created reservations ['aa5f2e59-3481-416b-8be8-84f6cee5f4ec', 'd669eb29-ff02-4abc-b6ca-f5b42c1ada90', 'c189a08b-9d90-4235-84c1-bba0cc946e0f', '36429dae-a2f0-4503-840e-e477e3cabe34', '1eef6d8e-925c-4124-a891-8df15f5fe556'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:40:59 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:40:59 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:40:59 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "cinder-5b3dde9a-4703-4d47-b730-ffc93129ffb5-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-5b3dde9a-4703-4d47-b730-ffc93129ffb5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:41:00 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.252s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:41:00 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Deleted volume successfully. Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "cinder-quobyte-5b3dde9a-4703-4d47-b730-ffc93129ffb5" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-675a55f6-3477-417c-a843-dcb308b2db39 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-e10fa951-2257-4e26-8e07-3f342df808ca-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-5b3dde9a-4703-4d47-b730-ffc93129ffb5" acquired by "delete_volume" :: waited 0.014s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1c3c80-d8f7-43d8-b452-1958e2f14825]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:00 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 Sep 23 00:41:00 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:00 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5" returned: 0 in 0.369s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:00 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5 Sep 23 00:41:00 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.flows.manager.create_volume [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87138) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Flow 'volume_create_manager' (6c892ac7-9f2a-4417-af20-43446cdbb950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba14cd9-75d0-418f-9c5f-cba403b32a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ba14cd9-75d0-418f-9c5f-cba403b32a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111376940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4573d382-4eed-441b-bd60-a7633896ef51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1d4cacae404b3aaa28d623faac106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:41:01Z,use_quota=True,user_id='91d71dd111914a188fd53a84d205aeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d0b975-25d1-4051-9a7e-eea84c834ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d0b975-25d1-4051-9a7e-eea84c834ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79309727-7c7e-499f-8bd8-4daae6e69382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79309727-7c7e-499f-8bd8-4daae6e69382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4573d382-4eed-441b-bd60-a7633896ef51', 'volume_name': 'volume-4573d382-4eed-441b-bd60-a7633896ef51', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583193f8-de96-48e1-bc65-701c2e86de68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (583193f8-de96-48e1-bc65-701c2e86de68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd10771-e3d4-4ca6-a92d-9c39ec5817ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:41:00 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Volume 4573d382-4eed-441b-bd60-a7633896ef51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4573d382-4eed-441b-bd60-a7633896ef51', 'volume_size': 1} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-22T22:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111376940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4573d382-4eed-441b-bd60-a7633896ef51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af1d4cacae404b3aaa28d623faac106f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-22T22:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-22T22:41:01Z,use_quota=True,user_id='91d71dd111914a188fd53a84d205aeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8),volume_type_id=8ceb48f0-c9a0-47a1-bc4c-e2b73d14f2b8)}" {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.remotefs [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Creating volume 4573d382-4eed-441b-bd60-a7633896ef51 {{(pid=87138) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Selected osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 as target Quobyte volume. {{(pid=87138) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 23 00:41:00 devstack cinder-volume[87138]: INFO cinder.volume.drivers.remotefs [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] casted to osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140 Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51 1073741824 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:00 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51 1073741824 Sep 23 00:41:00 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:00 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-5b3dde9a-4703-4d47-b730-ffc93129ffb5" returned: 0 in 0.245s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-5b3dde9a-4703-4d47-b730-ffc93129ffb5" released by "delete_volume" :: held 0.681s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:41:00 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Created reservations ['f491bad8-12e1-4a13-977b-eb413a3169d1', '3d9a7902-6191-4c3e-8ec6-0dbf41f1c6ab', '30b5dc02-dafe-4a45-a988-eec0d429e772', '31e5be84-1ad2-4126-84f6-993f9a8b7322', '56501628-e11e-4b0a-a455-ac4a5e65c775'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:01 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:41:01 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:01 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51 1073741824" returned: 0 in 0.443s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:01 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "cinder-2ac76ca6-13c6-4432-8e28-6a8f707d75fb-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:41:01 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51 Sep 23 00:41:01 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.308s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:41:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Deleted volume successfully. Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-2ac76ca6-13c6-4432-8e28-6a8f707d75fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-8fef4fa4-2d92-4796-933c-0bed968d7558 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-5b3dde9a-4703-4d47-b730-ffc93129ffb5-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "cinder-quobyte-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" acquired by "delete_volume" :: waited 0.018s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[34983ba9-6561-4992-bf91-f9696285dd63]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:01 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb Sep 23 00:41:01 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:01 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51" returned: 0 in 0.268s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'} {{(pid=87138) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd10771-e3d4-4ca6-a92d-9c39ec5817ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4573d382-4eed-441b-bd60-a7633896ef51', 'volume_size': 1}' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbea2c6-ebdd-429c-8fb1-129b51d417e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 23 00:41:01 devstack cinder-volume[87138]: INFO cinder.volume.flows.manager.create_volume [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Volume volume-4573d382-4eed-441b-bd60-a7633896ef51 (4573d382-4eed-441b-bd60-a7633896ef51): created successfully Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cbea2c6-ebdd-429c-8fb1-129b51d417e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87138) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Flow 'volume_create_manager' (6c892ac7-9f2a-4417-af20-43446cdbb950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87138) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 23 00:41:01 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-b949d2ed-b471-407b-a705-2a3724fc5bbf tempest-ProjectReaderTests-1920914117 None] Created volume successfully. Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "cinder-4573d382-4eed-441b-bd60-a7633896ef51-delete_volume" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-4573d382-4eed-441b-bd60-a7633896ef51-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "cinder-quobyte-4573d382-4eed-441b-bd60-a7633896ef51" by "delete_volume" {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 23 00:41:01 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-quobyte-4573d382-4eed-441b-bd60-a7633896ef51" acquired by "delete_volume" :: waited 0.020s {{(pid=87138) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" returned: 0 in 0.415s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo.privsep.daemon [-] privsep: reply[409586bf-79f9-4a72-b32c-c244166f42e9]: (4, 'qcow2') {{(pid=88568) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 23 00:41:01 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:01 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb Sep 23 00:41:01 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:02 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51 Sep 23 00:41:02 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:02 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" returned: 0 in 0.245s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-quobyte-2ac76ca6-13c6-4432-8e28-6a8f707d75fb" released by "delete_volume" :: held 0.704s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Created reservations ['e5894761-db56-42ad-a8b4-3eca830618f9', '43d3f65e-8387-414c-b688-a12040cd96b6', '81f1bd0a-e56b-4944-a639-ff6b65d53dea', '11199e51-0aa6-40f6-9d17-e746ef2d88ff', 'f1c954c5-036c-427c-89bf-2e595bb91161'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:41:02 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51" returned: 0 in 0.368s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:02 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51 Sep 23 00:41:02 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:02 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:41:02 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:02 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:02 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4/volume-4573d382-4eed-441b-bd60-a7633896ef51" returned: 0 in 0.273s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.262s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:41:02 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Deleted volume successfully. Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-quobyte-4573d382-4eed-441b-bd60-a7633896ef51" released by "delete_volume" :: held 0.703s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-241b9432-4683-41a4-a9c0-57c1da2d4f25 tempest-SnapshotDependencyTests-2009516681 None] Lock "cinder-2ac76ca6-13c6-4432-8e28-6a8f707d75fb-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.quota [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Created reservations ['9a57889e-5e48-42eb-ada5-6a612d930202', '52693f7d-625d-442f-893f-833813f8e6ff', 'fedb279b-3691-4bf3-ba02-c3964cc023f6', '3ce15987-27b8-476e-baac-e8202f5abb66', '81b3f207-4d95-4e21-9b9d-ed3df4fb82e5'] {{(pid=87138) _reserve /opt/stack/cinder/cinder/quota.py:797}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:02 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:41:02 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140': None} {{(pid=87138) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG cinder.volume.drivers.quobyte [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7558e79a-5d64-41ab-a753-b4e0da305140'] {{(pid=87138) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.lockutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87138) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 23 00:41:02 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 23 00:41:02 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4 Sep 23 00:41:02 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 23 00:41:03 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.280s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:41:03 devstack cinder-volume[87138]: INFO cinder.volume.manager [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Deleted volume successfully. Sep 23 00:41:03 devstack cinder-volume[87138]: DEBUG cinder.coordination [None req-4f1ef6e3-7ab5-4af1-9fe0-c16ec59d3f63 tempest-ProjectReaderTests-1920914117 None] Lock "cinder-4573d382-4eed-441b-bd60-a7633896ef51-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87138) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 23 00:41:03 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 23 00:41:03 devstack cinder-volume[87138]: DEBUG oslo_concurrency.processutils [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/03cc96bc132c8a85a96e2e339f69c5b4" returned: 0 in 0.296s {{(pid=87138) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 23 00:41:03 devstack cinder-volume[87138]: DEBUG cinder.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Notifying Schedulers of capabilities ... {{(pid=87138) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 23 00:41:03 devstack cinder-volume[87138]: DEBUG oslo_service.periodic_task [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] Running periodic task VolumeManager._thread_info {{(pid=87138) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 23 00:41:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread count: 29 {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 23 00:41:03 devstack cinder-volume[87138]: DEBUG cinder.volume.manager [None req-73642edc-3b9c-4050-8c37-b1270f04c00b None None] thread info: [<_MainThread(MainThread, started 127138278031488)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87138) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 23 00:41:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=81,cinder:UPDATE=100,cinder:DELETE=8,cinder:INSERT=25 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 23 00:41:19 devstack cinder-volume[87138]: DEBUG dbcounter [-] [87138] Writing DB stats cinder:SELECT=71,cinder:INSERT=29,cinder:UPDATE=109,cinder:DELETE=9 {{(pid=87138) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}